-- Logs begin at Tue 2022-07-26 15:24:06 UTC, end at Tue 2022-07-26 16:58:04 UTC. -- Jul 26 16:23:25.348728 dv-cinder-851042-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 16:23:25.360093 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 16:23:25 2022] *** Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: nodename: dv-cinder-851042-1-iscsi Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: machine: x86_64 Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: clock source: unix Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: pcre jit disabled Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: detected number of CPU cores: 4 Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: current working directory: / Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: detected binary path: /usr/bin/uwsgi-core Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: your processes number limit is 47680 Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: your memory page size is 4096 bytes Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: detected max file descriptor number: 2048 Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: lock engine: pthread robust mutexes Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: thunder lock: enabled Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 16:23:25.365612 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 16:23:25.406426 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: Python main interpreter initialized at 0x564e42ef79c0 Jul 26 16:23:25.406426 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: python threads support enabled Jul 26 16:23:25.406426 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: your server socket listen backlog is limited to 100 connections Jul 26 16:23:25.406426 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: your mercy for graceful operations on workers is 90 seconds Jul 26 16:23:25.406806 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 16:23:25.407901 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: *** Operational MODE: preforking *** Jul 26 16:23:25.408187 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: *** uWSGI is running in multiple interpreter mode *** Jul 26 16:23:25.408187 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: spawned uWSGI master process (pid: 103633) Jul 26 16:23:25.408981 dv-cinder-851042-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 16:23:25.413103 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: spawned uWSGI worker 1 (pid: 103634, cores: 1) Jul 26 16:23:25.413103 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: spawned uWSGI worker 2 (pid: 103635, cores: 1) Jul 26 16:23:25.413103 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 16:23:26.089872 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 16:23:26.122100 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 16:23:27.179539 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:23:27.179539 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: from cryptography.utils import int_from_bytes Jul 26 16:23:27.180172 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:23:27.180172 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: from cryptography.utils import int_from_bytes Jul 26 16:23:27.186074 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:23:27.186074 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: from cryptography.utils import int_from_bytes Jul 26 16:23:27.186497 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:23:27.186497 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: from cryptography.utils import int_from_bytes Jul 26 16:23:29.688229 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 16:23:29.688850 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 16:23:29.689017 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 16:23:29.689169 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 16:23:29.689540 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 16:23:29.690196 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 16:23:29.690300 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 16:23:29.690484 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 16:23:29.690593 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.690835 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.690931 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 16:23:29.691099 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 16:23:29.691248 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.691461 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.691561 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.691789 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.691890 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.692101 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.692199 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.692435 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.692544 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.692756 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.692861 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.693069 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.693164 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.693329 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.693424 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.693643 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.693735 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.693965 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851042-1-iscsi {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.694059 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.694258 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.694348 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.694577 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.694669 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.694886 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.694969 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851042-1-iscsi {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.695204 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.695295 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.695510 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.695593 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.695825 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.695920 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.696127 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.696219 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.696464 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.696658 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.696792 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.697098 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.697211 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.697407 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.697607 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.697721 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.697922 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.698025 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.698231 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.698333 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.698544 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.698638 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.698884 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.698980 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.699203 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.699298 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.699515 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.699604 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.699838 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.699932 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.700151 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.700246 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851042-1-iscsi {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.700515 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.700615 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.700818 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.700915 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.701190 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.701329 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851042-1-iscsi {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.701531 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.701634 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.701852 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.701944 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.702183 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.702333 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.702487 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.702573 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.702809 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.702910 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.703119 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.703206 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.703456 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.703550 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.703775 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.703872 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.704095 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.704184 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.704440 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.704529 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.704768 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.704869 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.705092 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.705179 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.705966 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.706071 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.706274 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.706362 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.706585 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.706695 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.706890 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.706984 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.707140 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.707244 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.707447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.707541 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.707768 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.707857 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.708032 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.708125 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.708343 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.708469 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.708658 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.708765 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.708910 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.709007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.709228 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.709322 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.709545 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.709641 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.709796 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.709884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.710118 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.710206 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.710438 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.710531 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.710744 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.710832 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.711049 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.711141 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.711351 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.711439 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.711656 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.711749 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.711961 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.712058 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.712267 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.712360 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.712601 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.712697 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.712911 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.713008 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.713216 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.713301 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.713532 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.713630 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.713852 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.713950 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.144 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.714161 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.714257 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.144 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.714468 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.714562 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.714804 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.714902 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.144 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.715106 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.144 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.715200 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.715415 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.715500 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.715731 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.715819 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.716049 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.716136 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.716355 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.716475 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.716688 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.716795 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.716993 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.717089 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.717306 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.717400 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.717616 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.717705 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.717918 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.718010 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.718169 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.718257 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.718470 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.718564 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.718774 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.718867 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.719091 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.719187 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.719395 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.719499 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.719697 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.719784 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.720000 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.720095 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.720298 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.720412 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.720629 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.720716 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.720959 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.721061 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.721262 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.721354 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.721563 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.721663 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.721868 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.721965 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.722171 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.722265 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.722477 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.722564 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.722780 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.722877 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.723085 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.723174 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.723394 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.723488 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.723703 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.723792 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.724007 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.724094 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.724312 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.724418 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.724652 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.724748 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.724958 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.725048 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.725264 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.725366 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.725568 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.725660 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.725871 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.725970 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.726190 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.726272 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.726770 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.726876 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.726953 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.727018 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.727094 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.727177 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.727395 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.727484 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.727700 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.727787 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.728016 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.728102 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.728315 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.728430 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.728648 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.728750 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.728962 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.729054 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.729265 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.729363 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.729568 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.729662 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.729871 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.729958 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.730174 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.730270 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.730476 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.730575 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.730780 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.730875 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.731080 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.731168 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.731382 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.731469 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.731681 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.731779 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.731983 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.732080 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.732288 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.732375 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.732615 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.732719 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.732919 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.733006 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.733223 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.733312 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.733539 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.733635 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.733848 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.733944 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.734157 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.734252 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.734480 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:23:29.734575 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.734816 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.734908 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.735147 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.735235 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.735478 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.735566 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.735795 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.735888 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.736106 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.736206 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.736441 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.737030 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.737296 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.737386 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.737609 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.737720 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.737918 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.738006 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.738230 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.738318 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.738545 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.738641 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.738858 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.738955 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.739173 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.739267 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.739485 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.739582 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.739800 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.739889 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.740116 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.740203 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.740507 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.740627 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.740769 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.740872 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.741088 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.741182 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.741404 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.741501 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.741712 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.741799 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.742040 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.742126 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.742414 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.742518 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.742688 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.742812 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.743009 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.743099 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.743330 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.743426 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.743642 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.743728 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.743954 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.744038 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.744263 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.744350 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.744606 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.744702 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.744924 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.745009 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.745237 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.745322 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.745558 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.745654 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.745866 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.745952 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.746175 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.746262 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.746482 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.746574 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.746791 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.746876 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.747104 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.747205 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.747419 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.747513 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.747732 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.747832 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.748042 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.748132 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.748356 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.748727 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.748953 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.749055 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.749262 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.749347 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.749571 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.749658 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.749878 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.749971 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.750182 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.750268 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.750486 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.750576 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.750789 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.750881 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.751096 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.751185 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.751396 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.751487 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.751713 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.751804 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.752012 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.752106 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.752908 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.753014 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.753237 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.753324 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.753542 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.753627 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.753854 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.753948 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.754167 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.754253 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.754477 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.754561 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.754785 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.754869 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.755096 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.755181 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.755406 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.755489 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.755714 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.755819 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.756026 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.756120 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.756335 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.756438 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.756667 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.756768 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.756994 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.757088 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.757300 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.757393 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.757605 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.757703 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.757914 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.757998 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.758226 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.758310 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.758530 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.758627 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.758841 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.759160 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.759255 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.759323 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.759496 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.759586 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.759771 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.759886 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.760083 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.760183 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.760430 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.760536 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.760752 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.760840 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.761059 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.761153 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.761384 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.761473 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.761710 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.761824 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.762018 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.762113 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.762321 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.762416 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.762633 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.762720 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.762957 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.763052 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.763243 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.763331 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.763547 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.763635 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.763857 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.763953 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.764160 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.764246 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.764486 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.764577 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.764796 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.764895 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.765101 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.765187 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.765406 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.765492 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.765713 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.765803 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.766018 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.766106 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.766321 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.766407 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.766625 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.766717 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.766929 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.767016 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.767234 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.767321 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.767540 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.767637 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.767882 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.767969 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.768232 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.768328 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.768569 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.768661 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.768917 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.769004 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.769230 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.769324 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.769552 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.769642 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.769866 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.769960 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.770180 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.770284 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.770493 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.770589 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.770806 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.770892 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.771124 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.771225 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.771436 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.771524 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.771753 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.771849 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.772061 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.772156 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.772405 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.772495 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.772721 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.772819 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.773034 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.773176 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.773341 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.773428 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.773659 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.773745 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.773982 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.774076 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.774294 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.774389 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.774614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.774702 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.774936 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.775023 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.775248 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.775336 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.775565 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.775661 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.775877 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.775975 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.776190 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.776278 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.776529 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.776620 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.782571 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.782690 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.782690 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.782831 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.782908 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.782986 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783076 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783163 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783286 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783373 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783451 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783528 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783613 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783700 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783778 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783855 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.783855 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784002 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784082 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784166 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784246 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784336 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784336 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784535 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784624 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784704 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784704 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784854 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.784931 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785017 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785096 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785181 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785260 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785337 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785421 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785512 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785591 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785669 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785745 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785821 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785821 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.785961 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786025 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786088 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786164 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786245 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786330 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786409 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786485 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786562 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786638 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786715 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786799 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786878 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.786955 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787032 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787032 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787179 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787268 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787353 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787353 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787494 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787577 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787651 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787717 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787793 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787870 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.787946 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.788021 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.788106 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.788106 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.788253 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.788332 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.788436 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.788527 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.788900 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.788985 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.789051 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.789051 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.789193 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.789322 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.789419 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.789629 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.789717 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.789936 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.790025 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.790242 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.790339 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.790556 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.790645 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.790876 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.790963 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.791186 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.791280 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.791499 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.791585 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.791807 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.791894 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.792116 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.792201 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.792452 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.792560 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.792764 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.792851 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.793073 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.793162 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.793383 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.793470 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.793694 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.793796 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.794003 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.794102 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.794311 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.794400 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.794621 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.794718 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.794927 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.795021 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.795235 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.795322 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.795544 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.795639 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.795847 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.795937 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.796156 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.796252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.796491 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.796594 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.796803 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.797066 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.797153 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.797399 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.797499 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.797714 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.797976 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.798064 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.798314 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.798410 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.798634 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.798724 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.798957 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.799534 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.799840 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.800177 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.800516 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.800831 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.801137 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.801443 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.801701 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.801790 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.802047 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.802142 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.802354 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.802441 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.802660 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.802998 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.803176 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.803276 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.803549 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.803647 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.803855 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.804012 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.804157 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.804346 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.804498 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.804787 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.805096 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.805401 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.805664 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.805751 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.806010 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.806099 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.806316 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.806412 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.806619 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.806715 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.806922 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.807009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.807261 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.807351 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.807606 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.807702 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.807932 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.808020 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.808253 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.808340 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.808595 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.808701 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.808916 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.809003 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.809223 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.809310 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.809543 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.809639 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.809846 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.809932 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.810150 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.810237 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.810452 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.810542 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.810763 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.810850 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.811073 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.811160 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.811378 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.811468 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.811686 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.811772 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.811995 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.812087 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.812305 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.812439 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.812639 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.812736 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.812941 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.813039 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.813253 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.813342 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.813557 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.813645 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.813872 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.813975 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.814181 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.814269 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.814484 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.814573 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.815330 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.815442 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.815639 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.815730 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.815996 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.816146 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.816319 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.816648 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.816756 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.816963 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.817049 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.817268 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.817355 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.817581 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.817666 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.817902 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.817993 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.818195 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.818298 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.818508 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.818594 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.818816 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.818901 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.819135 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.819235 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.819449 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.819546 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.819755 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.819848 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.820061 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.820155 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.820370 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.820474 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.820699 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.820793 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.821009 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.821214 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.821395 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.821538 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.821703 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.821850 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.822014 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.822174 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.822342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.822486 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.822657 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.822795 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.822961 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.823103 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.823274 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.823420 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.823579 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.823734 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.823883 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.824044 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.824188 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.824372 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.824527 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.824710 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.824816 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.825022 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.825109 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.825331 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.825429 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.825649 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.825738 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.825959 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.826048 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.826269 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.826355 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.826586 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.826674 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.826889 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.826983 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.827195 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.827284 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.827503 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.827592 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.827817 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.827904 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.828125 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.828220 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.828455 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.828560 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.828769 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.828935 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.829085 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.829192 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.829396 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.829494 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.829707 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.829794 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.830012 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.830107 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.830344 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.830441 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.830649 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.830735 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.830963 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.831064 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.831274 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.831368 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.831580 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.831666 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.831879 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.831974 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.832184 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.832272 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.832533 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.832633 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.832844 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.832936 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.833153 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.833241 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.833473 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.833572 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.833793 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.833882 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.834114 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.834208 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.834416 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.834504 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.834725 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.834814 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.835034 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.835130 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.835339 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.835425 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.835646 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.835734 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.835956 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.836043 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.836266 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.836354 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.836601 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.836699 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.836908 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.836994 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.837219 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.837316 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.837533 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.837627 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.837837 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.837931 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.838146 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.838246 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.838455 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.838543 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.838762 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.838858 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.839077 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.839173 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.839385 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.839472 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.839689 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.839784 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.839997 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.840092 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.840300 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.840416 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.840636 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.840737 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.840943 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.841033 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.841256 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.841376 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.841570 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.841688 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.841888 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.842001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.842207 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.842294 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.842521 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.842639 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.842836 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.842953 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.843152 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.843240 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.843461 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.843556 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.843789 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.843938 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.844103 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.844190 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.844431 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.844536 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.844748 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.844836 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.845059 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.845154 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.845374 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.845474 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.845690 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.845778 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.846024 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.846150 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.846351 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.846468 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.846661 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.846768 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.846967 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.847063 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.847269 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.847364 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.847596 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.847682 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.847899 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.847985 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.848218 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.848306 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.848621 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.848707 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.848963 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.849059 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.849272 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.849359 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.849646 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.849729 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.849962 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.850055 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.850270 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.850365 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.850575 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.850669 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.850891 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.850984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.851219 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.851313 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.851528 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.851623 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.851835 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.851938 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.852142 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.852237 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.852487 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.852584 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.852800 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.852919 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.853111 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.853215 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.853429 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.853526 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.853736 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.853833 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.854059 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.854163 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.854382 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.854527 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.854694 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.854841 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.855016 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.855156 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.855430 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.855518 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.855755 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.855846 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.856067 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.856164 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.856416 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.856507 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.856725 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.856813 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.857029 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.857118 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.857340 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.857428 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.857651 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.857740 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.857954 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.858043 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.858258 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.858346 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.858565 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.858652 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.858874 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.858962 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.859181 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.859269 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.859489 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.859585 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.859799 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.859889 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.860104 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.860214 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.860434 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.860571 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.860761 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.860887 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.861066 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.861211 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.861386 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.862060 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.862219 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.862372 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.862543 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.862681 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.862866 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.862998 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.863170 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.863306 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.863488 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.863613 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.863797 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.863939 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.864101 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.864248 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.864423 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.864654 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.864761 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.864969 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.865065 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.865282 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.865412 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.865591 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.865744 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.865899 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.866078 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.866230 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.866408 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.866538 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.866737 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.866895 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.867058 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.867200 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.867366 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.867514 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.867684 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.867824 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.868009 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.868150 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.868334 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.868501 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.868667 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.868814 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.868973 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.869111 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.869283 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.869434 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.869577 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.869713 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.869880 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.870026 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.870178 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.870324 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.870466 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.870602 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.870766 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.870904 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.871070 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.871214 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.871373 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.871511 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.871695 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.871833 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.871998 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.872151 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.872317 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.872478 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.872654 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.872788 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.872961 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.873122 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.873248 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.873431 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.873914 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.874061 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.874162 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.874380 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.874478 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.874689 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.874777 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.874996 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.875086 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.875304 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.875394 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.875617 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.875705 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.875924 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.876014 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.876235 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.876323 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.876585 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.876687 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.876916 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.877022 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.877269 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.877869 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.878105 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.878200 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.878419 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.878515 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.878726 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.878820 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.879035 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.879131 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.879340 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.879435 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.879654 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.879748 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.879974 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.880077 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.880296 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.880410 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.880640 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.880862 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.880948 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.881276 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.881373 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.881586 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.881679 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.881898 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.881982 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.882214 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.882300 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.882529 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.882621 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.882843 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.882953 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.883159 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.883256 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.883470 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.883566 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.883780 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.883884 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.884094 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.884187 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.884427 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.884520 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.884752 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.884859 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.885071 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.885165 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.885392 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.885479 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.885781 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.885935 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.886097 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.886266 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.886413 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.886585 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.886729 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.886903 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.887086 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.887219 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.887401 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.887535 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.887710 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.887852 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.888031 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.888168 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.888347 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.888533 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.888687 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.888809 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.889001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.889130 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.889315 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.889460 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.889630 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.889784 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.889943 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.890112 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.890255 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.890448 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.890565 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.890766 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.890863 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.891085 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.891183 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.891402 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.891491 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.891719 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.891817 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.892078 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.892178 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.892434 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.892528 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.892730 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.892819 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.893069 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.893167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.893390 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.893591 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.893707 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.893908 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.894006 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.894243 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.894338 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.894569 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.894674 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.894891 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.895000 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.895209 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.895298 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.895527 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.895615 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.895842 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.895942 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.896153 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.896240 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.896485 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.896579 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.896803 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.896894 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.897189 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.897375 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.897463 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.897540 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.897743 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.897834 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.898062 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.898153 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.898423 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.898580 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.898745 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.898900 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.899055 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.899235 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.899562 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.899650 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.899890 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.899987 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.900209 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.900306 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.900555 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.900658 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.900881 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.900969 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.901190 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.901277 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.901494 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.901590 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.901804 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.901892 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.902111 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.902197 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.902417 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.902514 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.902733 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.902820 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.903044 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.903131 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.903349 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.903446 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.903655 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.903751 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.903968 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.904064 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.904277 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.904526 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.904620 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.904884 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.904972 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.905209 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.905311 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.905543 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.905632 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.905846 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.905941 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.906152 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.906250 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.906458 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.906554 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.906771 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.906858 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.907076 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.907174 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.907381 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.907469 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.907684 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.907780 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.907992 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.908083 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.908299 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.908417 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.908650 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.908739 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.908963 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.909053 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.909269 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.909357 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.909575 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.909662 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.909877 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.909965 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.910186 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.910280 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.910515 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.910620 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.910824 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.910912 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.911134 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.911222 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.911434 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.911533 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.911745 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.911832 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.912052 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.912139 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.912356 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.912539 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.912692 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.912794 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.912994 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.913084 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.913310 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.913408 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.913621 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.913719 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.913932 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.914227 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.914326 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.914536 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.914623 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.914843 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.914939 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.915153 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.915250 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.915505 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.915593 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.915814 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.915911 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.916120 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.916217 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.916445 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.916537 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.916765 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.916853 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.917073 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.917173 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.917384 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.917526 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.917694 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.917784 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.918005 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.918107 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.918312 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.918406 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.918620 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.918709 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.918929 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.919178 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.919294 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.919514 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.919614 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.919823 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.919920 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.920129 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.920218 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.920458 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.920561 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.920768 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.920866 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.921080 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.921169 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.921391 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.921477 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.921716 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.921806 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.922030 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.922118 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.922344 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.922440 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.922657 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.922747 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.922963 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.923049 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.923271 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.923359 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.923580 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.923669 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.923887 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.923975 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.924738 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.924845 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.925052 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.925140 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.925367 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.925454 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.925668 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.925764 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.925982 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.926069 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.926293 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.926382 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.926610 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.926712 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.926955 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.927053 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.927278 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.927367 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.927595 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.927683 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.927913 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.928008 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.928219 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.928307 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.928558 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.928648 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.928873 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.928963 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.929184 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.929273 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.929494 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.929587 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.929813 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.929909 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.930143 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.930238 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.930449 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.930538 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.930753 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.930846 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.931054 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.931173 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.931363 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.931490 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.931680 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.931813 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.931990 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.932138 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.932291 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.932478 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.932618 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.932804 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.932928 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.933129 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.933220 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.933443 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.933531 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.933770 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.933876 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.934083 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.934180 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.934390 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.934478 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.934691 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.934787 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.934994 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.935091 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.935294 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.935390 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.935593 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.935691 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.935892 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.935981 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.936191 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.936279 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.936521 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.936614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.936825 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.936913 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.937125 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.937226 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.937427 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.937523 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.937728 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.937824 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.938034 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.938122 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.938362 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.938453 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.938664 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.938751 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.938970 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.939061 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.939274 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.939371 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.939586 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.939678 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.940463 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.940571 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.940777 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.940874 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.941089 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.941176 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.941396 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.941497 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.941701 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.941790 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.942007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.942094 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.942319 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.942419 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.942624 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.942714 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.942929 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.943018 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.943232 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.943328 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.943537 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.943626 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.943842 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.943940 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.944174 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.944270 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.944534 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.944624 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.944855 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.944943 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.945163 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.945251 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.945481 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.945575 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.945794 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.945883 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.946111 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.946237 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.946426 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.946513 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.946735 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.946833 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.947053 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.947141 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.947361 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.947447 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.947670 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.947873 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.947988 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.948086 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.948297 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.948438 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.948631 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.948737 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.948945 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.949042 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.949251 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.949338 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.949560 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.949658 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.949873 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.949962 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.950186 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.950273 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.950495 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.950583 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.950821 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.950909 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.951128 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.951222 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.951450 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.951539 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.951770 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.951857 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.952086 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.952174 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.952431 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.952523 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.952748 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.952843 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.953063 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.953165 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.953377 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.953465 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.953689 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.953776 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.953997 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.954097 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.954242 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103635) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 16:23:29.954333 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.954611 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.954924 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.955246 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.955592 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.955929 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.956259 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.956603 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.956934 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.957263 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.957614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.957932 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.958276 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.958605 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.958924 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.959237 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.959545 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:23:29.959789 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103634) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 16:23:30.107743 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO dbcounter [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Registered counter for database nova_api Jul 26 16:23:30.113271 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO dbcounter [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Registered counter for database nova_api Jul 26 16:23:30.129739 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:23:30.133902 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG oslo_db.sqlalchemy.engines [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:23:30.136195 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writer thread running {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:23:30.140363 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG dbcounter [-] [103634] Writer thread running {{(pid=103634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:23:30.191954 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.context [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),499fcfc6-ab87-45d5-8d28-bf683a10ff8a(cell1) {{(pid=103635) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 16:23:30.195950 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:23:30.196089 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.context [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),499fcfc6-ab87-45d5-8d28-bf683a10ff8a(cell1) {{(pid=103634) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 16:23:30.197572 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:23:30.198352 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:23:30.199989 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG oslo_concurrency.lockutils [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:23:30.200309 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:23:30.201606 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG oslo_concurrency.lockutils [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:23:30.202307 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO dbcounter [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Registered counter for database nova_cell0 Jul 26 16:23:30.202421 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG oslo_concurrency.lockutils [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:23:30.204401 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG oslo_concurrency.lockutils [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103634) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:23:30.206406 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO dbcounter [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Registered counter for database nova_cell0 Jul 26 16:23:30.207705 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO dbcounter [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Registered counter for database nova_cell1 Jul 26 16:23:30.211831 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO dbcounter [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Registered counter for database nova_cell1 Jul 26 16:23:30.214811 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:23:30.217014 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:23:30.218834 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG oslo_db.sqlalchemy.engines [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:23:30.221551 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG oslo_db.sqlalchemy.engines [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:23:30.222478 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writer thread running {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:23:30.225243 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writer thread running {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:23:30.228544 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG dbcounter [-] [103634] Writer thread running {{(pid=103634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:23:30.229988 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG dbcounter [-] [103634] Writer thread running {{(pid=103634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:23:30.368432 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO dbcounter [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Registered counter for database nova_cell0 Jul 26 16:23:30.376145 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO dbcounter [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Registered counter for database nova_cell0 Jul 26 16:23:30.377109 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103635) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:23:30.381526 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writer thread running {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:23:30.384859 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG oslo_db.sqlalchemy.engines [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103634) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:23:30.389623 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG dbcounter [-] [103634] Writer thread running {{(pid=103634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:23:30.787775 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: WARNING keystonemiddleware.auth_token [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 16:23:30.794935 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: WARNING keystonemiddleware.auth_token [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 16:23:30.888248 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: WARNING keystonemiddleware.auth_token [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 16:23:30.896035 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: WARNING keystonemiddleware.auth_token [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 16:23:31.130996 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: WARNING keystonemiddleware.auth_token [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 16:23:31.137252 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: WARNING keystonemiddleware.auth_token [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 16:23:31.142703 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564e42ef79c0 pid: 103635 (default app) Jul 26 16:23:31.145578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:23:31.146795 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] 10.222.0.144 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001888 Jul 26 16:23:31.147213 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 1/1] 10.222.0.144 () {50 vars in 793 bytes} [Tue Jul 26 16:23:31 2022] GET /compute/v2.1/ => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:23:31.235500 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: WARNING keystonemiddleware.auth_token [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 16:23:31.242088 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: WARNING keystonemiddleware.auth_token [None req-9e2a917b-4084-4b74-bd79-8d9e7168cace None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 16:23:31.247373 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564e42ef79c0 pid: 103634 (default app) Jul 26 16:24:49.533494 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:24:49.534499 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001499 Jul 26 16:24:49.534887 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 2/2] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:24:49 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:24:49.546887 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG dbcounter [-] [103634] Writing DB stats nova_api:SELECT=3 {{(pid=103634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:49.548030 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG dbcounter [-] [103634] Writing DB stats nova_cell0:SELECT=3 {{(pid=103634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:49.548777 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG dbcounter [-] [103634] Writing DB stats nova_cell1:SELECT=3 {{(pid=103634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:49.550225 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG dbcounter [-] [103634] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:50.404430 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-bdca4f51-b87c-44a7-8f3a-a9d23708e213 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:24:50.434920 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-bdca4f51-b87c-44a7-8f3a-a9d23708e213 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.893332 Jul 26 16:24:50.435791 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 1/3] 10.222.0.144 () {60 vars in 1296 bytes} [Tue Jul 26 16:24:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:24:52.656630 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:24:52.658183 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-f7ba026c-ac25-4cd0-9aa7-ded6443e5b92 None None] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002110 Jul 26 16:24:52.658725 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 3/4] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:24:52 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:24:53.116902 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-9afb0f4b-67e8-4e50-a10a-78914538fdd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "disk": 1}} {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:24:53.137941 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:24:53.137941 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: warnings.warn(msg) Jul 26 16:24:53.262465 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-9afb0f4b-67e8-4e50-a10a-78914538fdd5 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.597022 Jul 26 16:24:53.263016 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 2/5] 10.222.0.144 () {64 vars in 1287 bytes} [Tue Jul 26 16:24:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 16:24:53.276861 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writing DB stats nova_api:SELECT=3 {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:53.278027 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writing DB stats nova_cell1:SELECT=3 {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:53.279384 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writing DB stats nova_cell0:SELECT=3 {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:53.280222 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:24:53.483109 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-8845a3ee-a600-45e7-9977-783b9885b2a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:24:53.487464 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:24:53.487464 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: warnings.warn(msg) Jul 26 16:24:53.615424 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-8845a3ee-a600-45e7-9977-783b9885b2a9 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.343812 Jul 26 16:24:53.617028 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 4/6] 10.222.0.144 () {64 vars in 1340 bytes} [Tue Jul 26 16:24:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:24:55.839552 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-9afb0f4b-67e8-4e50-a10a-78914538fdd5 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:24:55.840654 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-9afb0f4b-67e8-4e50-a10a-78914538fdd5 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001473 Jul 26 16:24:55.841232 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 3/7] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:24:55 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:24:56.484527 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-0db1f8d0-5424-4ea4-b886-935a3e3c3f2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "id": "d1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:24:56.506681 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:24:56.506681 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: warnings.warn(msg) Jul 26 16:24:56.602302 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-0db1f8d0-5424-4ea4-b886-935a3e3c3f2f admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.755270 Jul 26 16:24:56.602899 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 5/8] 10.222.0.144 () {64 vars in 1287 bytes} [Tue Jul 26 16:24:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:24:56.622426 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-0a9c3bbb-4b65-4cf7-9240-a69be551af35 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:24:56.634665 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:24:56.634665 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: warnings.warn(msg) Jul 26 16:24:56.724626 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-0a9c3bbb-4b65-4cf7-9240-a69be551af35 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113062 Jul 26 16:24:56.726162 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 4/9] 10.222.0.144 () {64 vars in 1340 bytes} [Tue Jul 26 16:24:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:24:58.932080 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-0db1f8d0-5424-4ea4-b886-935a3e3c3f2f admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:24:58.933216 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-0db1f8d0-5424-4ea4-b886-935a3e3c3f2f admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001529 Jul 26 16:24:58.933993 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 6/10] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:24:58 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:24:59.347406 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-cc194a08-499c-43a6-9499-2433b7921b22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d2", "ram": 1024, "disk": 10, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:24:59.428316 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-cc194a08-499c-43a6-9499-2433b7921b22 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.489017 Jul 26 16:24:59.428947 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 5/11] 10.222.0.144 () {64 vars in 1287 bytes} [Tue Jul 26 16:24:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:24:59.440871 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-a609906f-ad08-4368-ad37-8f3aaf098ce8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:24:59.530299 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-a609906f-ad08-4368-ad37-8f3aaf098ce8 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093102 Jul 26 16:24:59.530887 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 7/12] 10.222.0.144 () {64 vars in 1340 bytes} [Tue Jul 26 16:24:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:25:01.815333 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-cc194a08-499c-43a6-9499-2433b7921b22 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:01.815333 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-cc194a08-499c-43a6-9499-2433b7921b22 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002335 Jul 26 16:25:01.815333 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 6/13] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:25:01 2022] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:02.221791 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-97a02ddc-bd8a-4b2c-b762-2ece68e3566d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "vcpus": 2, "name": "ds2G", "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:02.322311 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-97a02ddc-bd8a-4b2c-b762-2ece68e3566d admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.545395 Jul 26 16:25:02.322791 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 8/14] 10.222.0.144 () {64 vars in 1287 bytes} [Tue Jul 26 16:25:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:25:02.335796 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-d457fc05-f76a-402e-9bf6-01e5a30a4d14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:02.423385 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-d457fc05-f76a-402e-9bf6-01e5a30a4d14 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091758 Jul 26 16:25:02.423996 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 7/15] 10.222.0.144 () {64 vars in 1340 bytes} [Tue Jul 26 16:25:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:25:04.662308 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-97a02ddc-bd8a-4b2c-b762-2ece68e3566d admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:04.663356 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-97a02ddc-bd8a-4b2c-b762-2ece68e3566d admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001445 Jul 26 16:25:04.663758 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 9/16] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:25:04 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:05.095133 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-0dcad1b9-caa1-4fc8-b59d-1d764ad00903 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "ram": 4096, "id": "d4", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:05.176190 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-0dcad1b9-caa1-4fc8-b59d-1d764ad00903 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.506366 Jul 26 16:25:05.183400 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 8/17] 10.222.0.144 () {64 vars in 1287 bytes} [Tue Jul 26 16:25:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:25:05.189613 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-fc9698a5-d874-4e58-9ad1-acabb258046a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:05.278694 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-fc9698a5-d874-4e58-9ad1-acabb258046a admin admin] 10.222.0.144 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092674 Jul 26 16:25:05.279270 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 10/18] 10.222.0.144 () {64 vars in 1340 bytes} [Tue Jul 26 16:25:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:25:07.767032 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-0dcad1b9-caa1-4fc8-b59d-1d764ad00903 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:07.768169 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-0dcad1b9-caa1-4fc8-b59d-1d764ad00903 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001576 Jul 26 16:25:07.768695 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 9/19] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:25:07 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:08.239476 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-6f7c8361-0e78-4346-8f59-d4c03676a560 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:08.265974 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-6f7c8361-0e78-4346-8f59-d4c03676a560 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.491034 Jul 26 16:25:08.266770 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 11/20] 10.222.0.144 () {60 vars in 1296 bytes} [Tue Jul 26 16:25:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:25:10.762086 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-0dcad1b9-caa1-4fc8-b59d-1d764ad00903 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:10.763031 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-0dcad1b9-caa1-4fc8-b59d-1d764ad00903 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001478 Jul 26 16:25:10.763467 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 10/21] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:25:10 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:25:11.207210 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-2971112a-b59f-4fab-9174-fec400a1eaaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "1", "ram": 512}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:11.281096 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-2971112a-b59f-4fab-9174-fec400a1eaaf admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.510427 Jul 26 16:25:11.284199 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 12/22] 10.222.0.144 () {64 vars in 1287 bytes} [Tue Jul 26 16:25:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:25:11.296508 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-0595da47-2d51-4e3f-886a-97b03b6be6a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:11.376513 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-0595da47-2d51-4e3f-886a-97b03b6be6a3 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084799 Jul 26 16:25:11.377065 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 11/23] 10.222.0.144 () {64 vars in 1337 bytes} [Tue Jul 26 16:25:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:25:13.641718 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-2971112a-b59f-4fab-9174-fec400a1eaaf admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:13.642729 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-2971112a-b59f-4fab-9174-fec400a1eaaf admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001457 Jul 26 16:25:13.643135 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 13/24] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:25:13 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:14.040984 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-705818ee-5589-4b13-84cd-1270a5abb925 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:14.114632 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-705818ee-5589-4b13-84cd-1270a5abb925 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.465568 Jul 26 16:25:14.120830 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 12/25] 10.222.0.144 () {64 vars in 1287 bytes} [Tue Jul 26 16:25:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 16:25:14.127595 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-4035e91b-1a67-427d-ad2a-513fdf855ea5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:14.204814 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-4035e91b-1a67-427d-ad2a-513fdf855ea5 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080860 Jul 26 16:25:14.205384 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 14/26] 10.222.0.144 () {64 vars in 1337 bytes} [Tue Jul 26 16:25:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:25:16.387886 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-705818ee-5589-4b13-84cd-1270a5abb925 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:16.391600 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-705818ee-5589-4b13-84cd-1270a5abb925 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.004102 Jul 26 16:25:16.392210 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 13/27] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:25:16 2022] GET /compute/v2.1 => generated 389 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:16.750010 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-eb0148e9-b148-4023-9206-7cfbb5c553fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "disk": 40, "name": "m1.medium", "swap": 0}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:16.829785 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-eb0148e9-b148-4023-9206-7cfbb5c553fd admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.431099 Jul 26 16:25:16.830617 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 15/28] 10.222.0.144 () {64 vars in 1287 bytes} [Tue Jul 26 16:25:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:25:16.843908 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-20f7dfee-2ba7-4241-8ed0-ec818b98ea7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:16.924860 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-20f7dfee-2ba7-4241-8ed0-ec818b98ea7c admin admin] 10.222.0.144 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085398 Jul 26 16:25:16.925714 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 14/29] 10.222.0.144 () {64 vars in 1337 bytes} [Tue Jul 26 16:25:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:25:19.414556 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-eb0148e9-b148-4023-9206-7cfbb5c553fd admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:19.415480 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-eb0148e9-b148-4023-9206-7cfbb5c553fd admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002031 Jul 26 16:25:19.415877 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 16/30] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:25:19 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:19.959632 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-123555e4-42b0-4d2d-b312-0e9283ad9aff admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:19.965970 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG dbcounter [-] [103634] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:20.058959 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-123555e4-42b0-4d2d-b312-0e9283ad9aff admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.635800 Jul 26 16:25:20.059845 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 15/31] 10.222.0.144 () {64 vars in 1287 bytes} [Tue Jul 26 16:25:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 16:25:20.072254 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-eb9dc30a-a452-4969-a2fd-149668a202e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:20.143236 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-eb9dc30a-a452-4969-a2fd-149668a202e5 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075174 Jul 26 16:25:20.143892 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 17/32] 10.222.0.144 () {64 vars in 1337 bytes} [Tue Jul 26 16:25:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:25:22.501510 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-123555e4-42b0-4d2d-b312-0e9283ad9aff admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:22.502180 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-123555e4-42b0-4d2d-b312-0e9283ad9aff admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001489 Jul 26 16:25:22.510470 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 16/33] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:25:22 2022] GET /compute/v2.1 => generated 389 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:23.010199 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-00298ed5-bce6-4e80-b594-7a55d9253101 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:23.066529 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-00298ed5-bce6-4e80-b594-7a55d9253101 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.556703 Jul 26 16:25:23.067294 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 18/34] 10.222.0.144 () {64 vars in 1287 bytes} [Tue Jul 26 16:25:22 2022] POST /compute/v2.1/flavors => generated 410 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 16:25:23.079470 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-bd85e76a-a389-4624-afd3-052745c8356a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:23.142500 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-bd85e76a-a389-4624-afd3-052745c8356a admin admin] 10.222.0.144 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066655 Jul 26 16:25:23.143079 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 17/35] 10.222.0.144 () {64 vars in 1337 bytes} [Tue Jul 26 16:25:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:25:43.862460 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-00298ed5-bce6-4e80-b594-7a55d9253101 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:43.863458 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-00298ed5-bce6-4e80-b594-7a55d9253101 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001432 Jul 26 16:25:43.863858 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 19/36] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:25:43 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:44.255540 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-126f55e5-2733-4391-bbe6-4ad5643a6096 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:44.275796 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-126f55e5-2733-4391-bbe6-4ad5643a6096 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.406164 Jul 26 16:25:44.276265 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 18/37] 10.222.0.144 () {60 vars in 1296 bytes} [Tue Jul 26 16:25:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:25:45.330466 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-00298ed5-bce6-4e80-b594-7a55d9253101 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:45.331474 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-00298ed5-bce6-4e80-b594-7a55d9253101 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001426 Jul 26 16:25:45.331904 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 20/38] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:25:45 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:45.848711 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-99681d01-dbef-408b-b4bb-334b787af4e5 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:45.854739 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.wsgi [None req-99681d01-dbef-408b-b4bb-334b787af4e5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-99681d01-dbef-408b-b4bb-334b787af4e5 admin admin] Request method failure captured: Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Accept: application/json Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Accept-Encoding: gzip, deflate Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Connection: keep-alive Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Content-Length: 0 Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Host: 10.222.0.144 Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Openstack-Api-Version: compute 2.90 Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Openstack-System-Scope: None Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: User-Agent: python-novaclient Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Auth-Token: gAAAAABi4BWJiorzKNYjk8S3GHGAgj3ZI4sTyF9wd4-2locc1rgFkY-uOFTL-b8W0atEgIA7QlqY_jsaNZBjjDaJ34tWfxKWmGCBc-twLA7qmrY933eqbwE0HSDAd-HMWxPbuvbB8S9V2yE19Qr67YoqGhUdY8upTlYhBPY8rBr2X72cT-KEjTE Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Domain-Id: None Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Domain-Name: None Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Identity-Status: Confirmed Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Is-Admin-Project: True Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Domain-Id: default Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Domain-Name: Default Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Name: admin Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Role: member,admin,reader Jul 26 16:25:45.858009 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Roles: member,admin,reader Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/bf7f222516294286bf361e9d63865e13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_bf7f222516294286bf361e9d63865e13", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Tenant: admin Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Tenant-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Tenant-Name: admin Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User: admin Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Domain-Id: default Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Domain-Name: Default Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Id: d88063924d80461f80d0ee08a35cdcfc Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Name: admin Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: method: > Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: exception: Flavor 42 could not be found. Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: action_args: {'id': '42'} Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:25:45.859614 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:45.860704 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:45.862188 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-99681d01-dbef-408b-b4bb-334b787af4e5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:25:45.863541 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-99681d01-dbef-408b-b4bb-334b787af4e5 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390440 Jul 26 16:25:45.863541 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 19/39] 10.222.0.144 () {60 vars in 1195 bytes} [Tue Jul 26 16:25:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:45.869685 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-2d84b927-a09a-49ee-b289-7e3a6e87a0f2 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:45.873848 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:25:45.892622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-2d84b927-a09a-49ee-b289-7e3a6e87a0f2 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027026 Jul 26 16:25:45.893157 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 21/40] 10.222.0.144 () {60 vars in 1215 bytes} [Tue Jul 26 16:25:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:25:45.902980 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-9c3c65f3-8b4f-4407-8c60-5bdfbda588d1 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:45.927045 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-9c3c65f3-8b4f-4407-8c60-5bdfbda588d1 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.027644 Jul 26 16:25:45.927583 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 20/41] 10.222.0.144 () {60 vars in 1215 bytes} [Tue Jul 26 16:25:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:25:45.937450 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-6d4117d9-9510-4b0b-96b6-6004796f257e admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:45.943396 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.wsgi [None req-6d4117d9-9510-4b0b-96b6-6004796f257e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-6d4117d9-9510-4b0b-96b6-6004796f257e admin admin] Request method failure captured: Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Accept: application/json Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Accept-Encoding: gzip, deflate Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Connection: keep-alive Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Content-Length: 0 Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Host: 10.222.0.144 Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Openstack-Api-Version: compute 2.90 Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Openstack-System-Scope: None Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: User-Agent: python-novaclient Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Auth-Token: gAAAAABi4BWJiorzKNYjk8S3GHGAgj3ZI4sTyF9wd4-2locc1rgFkY-uOFTL-b8W0atEgIA7QlqY_jsaNZBjjDaJ34tWfxKWmGCBc-twLA7qmrY933eqbwE0HSDAd-HMWxPbuvbB8S9V2yE19Qr67YoqGhUdY8upTlYhBPY8rBr2X72cT-KEjTE Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Domain-Id: None Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Domain-Name: None Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Identity-Status: Confirmed Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Is-Admin-Project: True Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Domain-Id: default Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Domain-Name: Default Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Name: admin Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Role: member,admin,reader Jul 26 16:25:45.946664 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Roles: member,admin,reader Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/bf7f222516294286bf361e9d63865e13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_bf7f222516294286bf361e9d63865e13", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Tenant: admin Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Tenant-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Tenant-Name: admin Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User: admin Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Domain-Id: default Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Domain-Name: Default Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Id: d88063924d80461f80d0ee08a35cdcfc Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Name: admin Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: method: > Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: exception: Flavor 42 could not be found. Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: action_args: {'id': '42'} Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:25:45.951578 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:45.952677 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:45.953984 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-6d4117d9-9510-4b0b-96b6-6004796f257e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:25:45.955345 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-6d4117d9-9510-4b0b-96b6-6004796f257e admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014100 Jul 26 16:25:45.955345 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 22/42] 10.222.0.144 () {60 vars in 1195 bytes} [Tue Jul 26 16:25:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 26 16:25:46.910014 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-9c3c65f3-8b4f-4407-8c60-5bdfbda588d1 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:46.911020 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-9c3c65f3-8b4f-4407-8c60-5bdfbda588d1 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001431 Jul 26 16:25:46.911748 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 21/43] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:25:46 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:47.430037 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-86a60f2a-11c7-4339-affa-15965cbe3e46 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:47.435904 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.wsgi [None req-86a60f2a-11c7-4339-affa-15965cbe3e46 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-86a60f2a-11c7-4339-affa-15965cbe3e46 admin admin] Request method failure captured: Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Accept: application/json Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Accept-Encoding: gzip, deflate Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Connection: keep-alive Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Content-Length: 0 Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Host: 10.222.0.144 Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Openstack-Api-Version: compute 2.90 Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Openstack-System-Scope: None Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: User-Agent: python-novaclient Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Auth-Token: gAAAAABi4BWKCcjWUY6H2HDt0AVPcvk5LLR9kpAGIzA6I4RFaq_j0SXc5Pjd95Z66Ah3Qk-i8HXZedEVRXuwOwS1Snr4XnD2FcQBBeP5BlWQ9N-GILzMJp47jSJ2GYJ4Tz7Ilf5t0KnJz3teKlYQ67J8bRYhsFq6FG-wB9EzRSTsuswYotn5Rvs Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Domain-Id: None Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Domain-Name: None Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Identity-Status: Confirmed Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Is-Admin-Project: True Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Domain-Id: default Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Domain-Name: Default Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Name: admin Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Role: member,admin,reader Jul 26 16:25:47.437447 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Roles: member,admin,reader Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/bf7f222516294286bf361e9d63865e13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_bf7f222516294286bf361e9d63865e13", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Tenant: admin Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Tenant-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Tenant-Name: admin Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User: admin Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Domain-Id: default Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Domain-Name: Default Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Id: d88063924d80461f80d0ee08a35cdcfc Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Name: admin Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: method: > Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: exception: Flavor 84 could not be found. Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: action_args: {'id': '84'} Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:25:47.439019 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:47.439884 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:47.441342 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-86a60f2a-11c7-4339-affa-15965cbe3e46 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:25:47.442597 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-86a60f2a-11c7-4339-affa-15965cbe3e46 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.387785 Jul 26 16:25:47.442597 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 23/44] 10.222.0.144 () {60 vars in 1195 bytes} [Tue Jul 26 16:25:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:47.448442 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-d67ade06-4cfc-44f3-a5bf-e4dfd7dc7cd3 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:47.464129 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-d67ade06-4cfc-44f3-a5bf-e4dfd7dc7cd3 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019266 Jul 26 16:25:47.464861 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 22/45] 10.222.0.144 () {60 vars in 1215 bytes} [Tue Jul 26 16:25:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:25:47.474272 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-a366ca56-8ee1-4069-b98a-cfe6f62d77f9 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:47.489867 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-a366ca56-8ee1-4069-b98a-cfe6f62d77f9 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.019091 Jul 26 16:25:47.490582 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 24/46] 10.222.0.144 () {60 vars in 1215 bytes} [Tue Jul 26 16:25:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:25:47.507891 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-a396492f-38dd-4a5f-a590-b2b699375e14 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:47.513321 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.wsgi [None req-a396492f-38dd-4a5f-a590-b2b699375e14 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-a396492f-38dd-4a5f-a590-b2b699375e14 admin admin] Request method failure captured: Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Accept: application/json Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Accept-Encoding: gzip, deflate Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Connection: keep-alive Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Content-Length: 0 Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Host: 10.222.0.144 Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Openstack-Api-Version: compute 2.90 Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Openstack-System-Scope: None Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: User-Agent: python-novaclient Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Auth-Token: gAAAAABi4BWKCcjWUY6H2HDt0AVPcvk5LLR9kpAGIzA6I4RFaq_j0SXc5Pjd95Z66Ah3Qk-i8HXZedEVRXuwOwS1Snr4XnD2FcQBBeP5BlWQ9N-GILzMJp47jSJ2GYJ4Tz7Ilf5t0KnJz3teKlYQ67J8bRYhsFq6FG-wB9EzRSTsuswYotn5Rvs Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Domain-Id: None Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Domain-Name: None Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Identity-Status: Confirmed Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Is-Admin-Project: True Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Domain-Id: default Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Domain-Name: Default Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Name: admin Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Role: member,admin,reader Jul 26 16:25:47.514827 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Roles: member,admin,reader Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/bf7f222516294286bf361e9d63865e13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_bf7f222516294286bf361e9d63865e13", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Tenant: admin Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Tenant-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Tenant-Name: admin Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User: admin Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Domain-Id: default Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Domain-Name: Default Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Id: d88063924d80461f80d0ee08a35cdcfc Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Name: admin Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: method: > Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: exception: Flavor 84 could not be found. Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: action_args: {'id': '84'} Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:25:47.516252 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:47.517121 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:47.518167 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-a396492f-38dd-4a5f-a590-b2b699375e14 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:25:47.519354 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-a396492f-38dd-4a5f-a590-b2b699375e14 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012160 Jul 26 16:25:47.519354 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 23/47] 10.222.0.144 () {60 vars in 1195 bytes} [Tue Jul 26 16:25:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:48.475623 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-a366ca56-8ee1-4069-b98a-cfe6f62d77f9 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:48.476661 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-a366ca56-8ee1-4069-b98a-cfe6f62d77f9 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001489 Jul 26 16:25:48.477621 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 25/48] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:25:48 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:48.987332 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-80039cea-bed3-4825-a5ac-57ec467cbde5 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:48.993046 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.wsgi [None req-80039cea-bed3-4825-a5ac-57ec467cbde5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-80039cea-bed3-4825-a5ac-57ec467cbde5 admin admin] Request method failure captured: Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Accept: application/json Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Accept-Encoding: gzip, deflate Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Connection: keep-alive Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Content-Length: 0 Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Host: 10.222.0.144 Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Openstack-Api-Version: compute 2.90 Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Openstack-System-Scope: None Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: User-Agent: python-novaclient Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Auth-Token: gAAAAABi4BWMu4YSlSKan87q8V_ddNoJuMV7CSBA-1rDJCr9-mlPznzhMhWGVwQbgUm-hivYGbwL8Psz0RMsBG_VLyRD0v010gBrRRCQHr0lo9RgrWj8awiFUUhuIoopGd-Q0RfEPp9ofW9nviJ_AVJTw4dd1p93IIJ1z6yR9QI6Zo2h_Jgh8SU Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Domain-Id: None Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Domain-Name: None Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Identity-Status: Confirmed Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Is-Admin-Project: True Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Domain-Id: default Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Domain-Name: Default Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Project-Name: admin Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Role: member,admin,reader Jul 26 16:25:48.994532 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Roles: member,admin,reader Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/bf7f222516294286bf361e9d63865e13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_bf7f222516294286bf361e9d63865e13", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Tenant: admin Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Tenant-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-Tenant-Name: admin Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User: admin Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Domain-Id: default Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Domain-Name: Default Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Id: d88063924d80461f80d0ee08a35cdcfc Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: X-User-Name: admin Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: method: > Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: exception: Flavor 451 could not be found. Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: action_args: {'id': '451'} Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:25:48.996007 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:48.996967 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: ERROR nova.api.openstack.wsgi Jul 26 16:25:48.998208 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-80039cea-bed3-4825-a5ac-57ec467cbde5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103634) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:25:48.999520 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-80039cea-bed3-4825-a5ac-57ec467cbde5 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.381609 Jul 26 16:25:48.999520 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 24/49] 10.222.0.144 () {60 vars in 1198 bytes} [Tue Jul 26 16:25:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 383 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:49.005368 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-35d53ec6-b822-4115-a90c-cd3521232bb6 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:49.020645 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-35d53ec6-b822-4115-a90c-cd3521232bb6 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.018730 Jul 26 16:25:49.021157 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 26/50] 10.222.0.144 () {60 vars in 1215 bytes} [Tue Jul 26 16:25:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:25:49.030754 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:49.045209 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.90 time: 0.017915 Jul 26 16:25:49.045728 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 25/51] 10.222.0.144 () {60 vars in 1215 bytes} [Tue Jul 26 16:25:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:25:49.054373 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-d4866431-6f01-4632-82ca-116296fb3f94 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:49.059490 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.wsgi [None req-d4866431-6f01-4632-82ca-116296fb3f94 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-d4866431-6f01-4632-82ca-116296fb3f94 admin admin] Request method failure captured: Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Accept: application/json Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Accept-Encoding: gzip, deflate Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Connection: keep-alive Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Content-Length: 0 Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Host: 10.222.0.144 Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Openstack-Api-Version: compute 2.90 Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Openstack-System-Scope: None Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: User-Agent: python-novaclient Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Auth-Token: gAAAAABi4BWMu4YSlSKan87q8V_ddNoJuMV7CSBA-1rDJCr9-mlPznzhMhWGVwQbgUm-hivYGbwL8Psz0RMsBG_VLyRD0v010gBrRRCQHr0lo9RgrWj8awiFUUhuIoopGd-Q0RfEPp9ofW9nviJ_AVJTw4dd1p93IIJ1z6yR9QI6Zo2h_Jgh8SU Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Domain-Id: None Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Domain-Name: None Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Identity-Status: Confirmed Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Is-Admin-Project: True Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Openstack-Nova-Api-Version: 2.90 Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Domain-Id: default Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Domain-Name: Default Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Project-Name: admin Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Role: member,admin,reader Jul 26 16:25:49.061001 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Roles: member,admin,reader Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/bf7f222516294286bf361e9d63865e13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/bf7f222516294286bf361e9d63865e13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_bf7f222516294286bf361e9d63865e13", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Tenant: admin Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Tenant-Id: bf7f222516294286bf361e9d63865e13 Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-Tenant-Name: admin Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User: admin Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Domain-Id: default Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Domain-Name: Default Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Id: d88063924d80461f80d0ee08a35cdcfc Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: X-User-Name: admin Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: method: > Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: exception: Flavor 451 could not be found. Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: action_args: {'id': '451'} Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:25:49.062517 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:49.063622 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: ERROR nova.api.openstack.wsgi Jul 26 16:25:49.064947 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-d4866431-6f01-4632-82ca-116296fb3f94 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103635) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:25:49.066163 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-d4866431-6f01-4632-82ca-116296fb3f94 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011374 Jul 26 16:25:49.066163 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 27/52] 10.222.0.144 () {60 vars in 1198 bytes} [Tue Jul 26 16:25:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 26 16:25:50.026166 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:50.027212 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001484 Jul 26 16:25:50.027610 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 26/53] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:25:50 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:25:50.562306 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-1edfec86-36c7-4ba7-b416-eb8f64a40169 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:50.635512 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-1edfec86-36c7-4ba7-b416-eb8f64a40169 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.90 time: 0.471071 Jul 26 16:25:50.636043 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 28/54] 10.222.0.144 () {64 vars in 1240 bytes} [Tue Jul 26 16:25:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 16:25:51.603427 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:51.604464 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002007 Jul 26 16:25:51.604859 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 27/55] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:25:51 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:25:52.117945 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-66fc1536-2bcc-4ff6-a683-08e7fa93d6e9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:52.195317 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-66fc1536-2bcc-4ff6-a683-08e7fa93d6e9 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.455901 Jul 26 16:25:52.195885 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 29/56] 10.222.0.144 () {64 vars in 1240 bytes} [Tue Jul 26 16:25:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:25:53.171580 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:53.172615 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001422 Jul 26 16:25:53.173004 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 28/57] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:25:53 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:53.705726 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-b24c162d-c210-4dd9-9e31-4d40b8221a14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:53.767243 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-b24c162d-c210-4dd9-9e31-4d40b8221a14 admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.454546 Jul 26 16:25:53.767782 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 30/58] 10.222.0.144 () {64 vars in 1240 bytes} [Tue Jul 26 16:25:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:25:54.740120 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:54.741174 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001462 Jul 26 16:25:54.741581 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 29/59] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:25:54 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:55.268983 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-3695e97f-3cee-4577-98b8-686cbad4873d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:25:55.367248 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-3695e97f-3cee-4577-98b8-686cbad4873d admin admin] 10.222.0.144 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.90 time: 0.474839 Jul 26 16:25:55.368276 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 31/60] 10.222.0.144 () {64 vars in 1240 bytes} [Tue Jul 26 16:25:54 2022] POST /compute/v2.1/flavors => generated 411 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:25:56.332655 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:56.333657 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001449 Jul 26 16:25:56.334050 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 30/61] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:25:56 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:25:56.858697 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-8d4f2ddb-28b8-4e30-9987-355fd3365fd3 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:25:56.879315 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-8d4f2ddb-28b8-4e30-9987-355fd3365fd3 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.90 time: 0.397989 Jul 26 16:25:56.879840 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 32/62] 10.222.0.144 () {60 vars in 1207 bytes} [Tue Jul 26 16:25:56 2022] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:26:48.000950 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:26:48.002006 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-c1bb4f9a-0ec9-4d27-a88b-64e53e572116 admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001462 Jul 26 16:26:48.002402 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 31/63] 10.222.0.144 () {54 vars in 935 bytes} [Tue Jul 26 16:26:47 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:26:48.013606 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:48.394829 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-8922dd05-ed44-42ae-a3dc-4313eb98b19e admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:26:48.416171 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-8922dd05-ed44-42ae-a3dc-4313eb98b19e admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.406886 Jul 26 16:26:48.416694 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 33/64] 10.222.0.144 () {60 vars in 1296 bytes} [Tue Jul 26 16:26:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:26:48.444160 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-8b7c02e6-88a3-44dc-9a04-25347866b7a7 admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:26:48.448408 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG dbcounter [-] [103634] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103634) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:26:48.453574 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-8b7c02e6-88a3-44dc-9a04-25347866b7a7 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013107 Jul 26 16:26:48.454104 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 32/65] 10.222.0.144 () {60 vars in 1287 bytes} [Tue Jul 26 16:26:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:26:48.465951 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-3d462ced-ab4c-4c71-bf27-3a1d77292fb6 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:26:48.473866 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-3d462ced-ab4c-4c71-bf27-3a1d77292fb6 admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011627 Jul 26 16:26:48.474472 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 34/66] 10.222.0.144 () {60 vars in 1290 bytes} [Tue Jul 26 16:26:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:26:48.486348 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-2f45c4b5-ad5e-4b8d-b76d-7aab13418ecf admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:26:48.495112 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-2f45c4b5-ad5e-4b8d-b76d-7aab13418ecf admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012603 Jul 26 16:26:48.495648 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 33/67] 10.222.0.144 () {60 vars in 1290 bytes} [Tue Jul 26 16:26:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:26:48.507432 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-c1e40c30-e043-4e6c-a229-f4010ee230ee admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:26:48.516235 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-c1e40c30-e043-4e6c-a229-f4010ee230ee admin admin] 10.222.0.144 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012298 Jul 26 16:26:48.516778 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 35/68] 10.222.0.144 () {60 vars in 1287 bytes} [Tue Jul 26 16:26:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:30:29.114216 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-2f45c4b5-ad5e-4b8d-b76d-7aab13418ecf admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:30:29.117717 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-2f45c4b5-ad5e-4b8d-b76d-7aab13418ecf admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001433 Jul 26 16:30:29.117717 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 34/69] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:30:29 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:30:29.255645 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writing DB stats nova_api:SELECT=6 {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:29.422886 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-746438e7-57da-4136-987c-26171009e6b5 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:30:29.426040 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:30:29.426040 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: warnings.warn(msg) Jul 26 16:30:29.427313 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-746438e7-57da-4136-987c-26171009e6b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:30:29.427761 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-746438e7-57da-4136-987c-26171009e6b5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:30:29.428606 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-746438e7-57da-4136-987c-26171009e6b5 admin admin] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:30:29.429045 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-746438e7-57da-4136-987c-26171009e6b5 admin admin] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:30:29.463815 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-746438e7-57da-4136-987c-26171009e6b5 admin admin] 10.222.0.144 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.209570 Jul 26 16:30:29.464424 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 36/70] 10.222.0.144 () {60 vars in 1198 bytes} [Tue Jul 26 16:30:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:30:30.298348 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-2f45c4b5-ad5e-4b8d-b76d-7aab13418ecf admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:30:30.299865 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-2f45c4b5-ad5e-4b8d-b76d-7aab13418ecf admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001949 Jul 26 16:30:30.300259 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 35/71] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:30:30 2022] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:30:30.494284 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-d6766018-587c-46ee-b190-a8250a4f0e41 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:30:30.496689 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:30:30.496689 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: warnings.warn(msg) Jul 26 16:30:30.498116 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-d6766018-587c-46ee-b190-a8250a4f0e41 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:30:30.498692 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-d6766018-587c-46ee-b190-a8250a4f0e41 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:30:30.499491 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-d6766018-587c-46ee-b190-a8250a4f0e41 admin admin] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:30:30.499924 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-d6766018-587c-46ee-b190-a8250a4f0e41 admin admin] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:30:30.520125 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-d6766018-587c-46ee-b190-a8250a4f0e41 admin admin] 10.222.0.144 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080229 Jul 26 16:30:30.521002 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 37/72] 10.222.0.144 () {60 vars in 1198 bytes} [Tue Jul 26 16:30:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:30:41.755037 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-2f45c4b5-ad5e-4b8d-b76d-7aab13418ecf admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:30:41.756123 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-2f45c4b5-ad5e-4b8d-b76d-7aab13418ecf admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001515 Jul 26 16:30:41.756658 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 36/73] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:30:41 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:30:41.899303 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writing DB stats nova_cell0:SELECT=4 {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:41.900030 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writing DB stats nova_cell1:SELECT=4 {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:41.900744 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG dbcounter [-] [103635] Writing DB stats nova_api:SELECT=8 {{(pid=103635) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:30:41.948605 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-fceb521f-db91-40e8-94b0-cba6910ff29f admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:30:41.950931 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:30:41.950931 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: warnings.warn(msg) Jul 26 16:30:41.952121 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-fceb521f-db91-40e8-94b0-cba6910ff29f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:30:41.952602 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-fceb521f-db91-40e8-94b0-cba6910ff29f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:30:41.953390 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-fceb521f-db91-40e8-94b0-cba6910ff29f admin admin] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:30:41.953822 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-fceb521f-db91-40e8-94b0-cba6910ff29f admin admin] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:30:41.979049 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-fceb521f-db91-40e8-94b0-cba6910ff29f admin admin] 10.222.0.144 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084320 Jul 26 16:30:41.979591 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 38/74] 10.222.0.144 () {60 vars in 1198 bytes} [Tue Jul 26 16:30:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:30:42.806857 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: DEBUG nova.api.openstack.wsgi [None req-2f45c4b5-ad5e-4b8d-b76d-7aab13418ecf admin admin] Calling method '>' {{(pid=103634) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:30:42.807862 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: INFO nova.api.openstack.requestlog [None req-2f45c4b5-ad5e-4b8d-b76d-7aab13418ecf admin admin] 10.222.0.144 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001455 Jul 26 16:30:42.808260 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: [pid: 103634|app: 0|req: 37/75] 10.222.0.144 () {56 vars in 1079 bytes} [Tue Jul 26 16:30:42 2022] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:30:42.998232 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG nova.api.openstack.wsgi [None req-06f14fb1-2b4e-4dea-a0a7-e3f67b500a83 admin admin] Calling method '>' {{(pid=103635) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:30:43.001173 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 16:30:43.001173 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: warnings.warn(msg) Jul 26 16:30:43.002399 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-06f14fb1-2b4e-4dea-a0a7-e3f67b500a83 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:30:43.002847 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-06f14fb1-2b4e-4dea-a0a7-e3f67b500a83 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:30:43.003639 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-06f14fb1-2b4e-4dea-a0a7-e3f67b500a83 admin admin] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:30:43.004074 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: DEBUG oslo_concurrency.lockutils [None req-06f14fb1-2b4e-4dea-a0a7-e3f67b500a83 admin admin] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103635) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:30:43.027317 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: INFO nova.api.openstack.requestlog [None req-06f14fb1-2b4e-4dea-a0a7-e3f67b500a83 admin admin] 10.222.0.144 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080352 Jul 26 16:30:43.027801 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: [pid: 103635|app: 0|req: 39/76] 10.222.0.144 () {60 vars in 1198 bytes} [Tue Jul 26 16:30:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:31:41.967399 dv-cinder-851042-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 26 16:31:41.967925 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: Tue Jul 26 16:31:41 2022 - graceful shutdown triggered... Jul 26 16:31:41.968349 dv-cinder-851042-1-iscsi devstack@n-api.service[103634]: Gracefully killing worker 1 (pid: 103634)... Jul 26 16:31:41.968861 dv-cinder-851042-1-iscsi devstack@n-api.service[103635]: Gracefully killing worker 2 (pid: 103635)... Jul 26 16:31:42.969088 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: worker 1 buried after 1 seconds Jul 26 16:31:42.969633 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: worker 2 buried after 1 seconds Jul 26 16:31:42.969633 dv-cinder-851042-1-iscsi devstack@n-api.service[103633]: goodbye to uWSGI. Jul 26 16:31:42.970725 dv-cinder-851042-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 26 16:31:42.971269 dv-cinder-851042-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 26 16:31:42.974045 dv-cinder-851042-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 26 16:31:42.983012 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 26 16:31:42.985069 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 16:31:42 2022] *** Jul 26 16:31:42.985069 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 16:31:42.985069 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 16:31:42.985069 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: nodename: dv-cinder-851042-1-iscsi Jul 26 16:31:42.985069 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: machine: x86_64 Jul 26 16:31:42.985069 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: clock source: unix Jul 26 16:31:42.985069 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: pcre jit disabled Jul 26 16:31:42.985069 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: detected number of CPU cores: 4 Jul 26 16:31:42.985069 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: current working directory: / Jul 26 16:31:42.985069 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: detected binary path: /usr/bin/uwsgi-core Jul 26 16:31:42.985705 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: your processes number limit is 47680 Jul 26 16:31:42.985705 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: your memory page size is 4096 bytes Jul 26 16:31:42.985705 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: detected max file descriptor number: 2048 Jul 26 16:31:42.985705 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: lock engine: pthread robust mutexes Jul 26 16:31:42.985705 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: thunder lock: enabled Jul 26 16:31:42.985705 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 26 16:31:42.985705 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 16:31:43.028771 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: Python main interpreter initialized at 0x561634c0b9c0 Jul 26 16:31:43.028771 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: python threads support enabled Jul 26 16:31:43.028771 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: your server socket listen backlog is limited to 100 connections Jul 26 16:31:43.028771 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: your mercy for graceful operations on workers is 90 seconds Jul 26 16:31:43.029211 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 16:31:43.029211 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: *** Operational MODE: preforking *** Jul 26 16:31:43.029469 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: *** uWSGI is running in multiple interpreter mode *** Jul 26 16:31:43.029469 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: spawned uWSGI master process (pid: 124800) Jul 26 16:31:43.029674 dv-cinder-851042-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 26 16:31:43.030819 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: spawned uWSGI worker 1 (pid: 124820, cores: 1) Jul 26 16:31:43.030819 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: spawned uWSGI worker 2 (pid: 124821, cores: 1) Jul 26 16:31:43.030819 dv-cinder-851042-1-iscsi devstack@n-api.service[124800]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 16:31:43.689906 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 16:31:43.693708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 26 16:31:44.848522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:31:44.848522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: from cryptography.utils import int_from_bytes Jul 26 16:31:44.849116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:31:44.849116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: from cryptography.utils import int_from_bytes Jul 26 16:31:44.849467 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:31:44.849467 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: from cryptography.utils import int_from_bytes Jul 26 16:31:44.849915 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 16:31:44.849915 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: from cryptography.utils import int_from_bytes Jul 26 16:31:47.273471 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 16:31:47.274146 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 16:31:47.274248 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 16:31:47.274601 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 16:31:47.274840 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 16:31:47.275228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.275556 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.276017 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.276224 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.276558 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.277581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.277581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.277769 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 16:31:47.278117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.278190 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 16:31:47.278285 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.278285 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.278427 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 16:31:47.278498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.278565 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 16:31:47.278810 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851042-1-iscsi {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.278916 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 16:31:47.279007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.279084 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.279475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.279647 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.279795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.279946 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.280105 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.280287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.280474 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.280622 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.280796 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.280951 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.281103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.281290 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.281444 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.281592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.281761 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.282231 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.282537 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.282958 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.283226 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.283384 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.283658 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.283821 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.283971 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.284094 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-851042-1-iscsi {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.284296 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.284513 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.284832 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.285742 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.286003 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.286280 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.286473 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851042-1-iscsi {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.286672 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.286772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.286938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.287076 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.287260 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.287353 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.287595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.287748 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.287915 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.288078 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.288380 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.288551 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.288840 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.289100 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.289203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.289461 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.289618 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.289722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.289807 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.289940 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.290033 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.290264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.290451 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.290587 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.290955 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.291071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.291211 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.291375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.291499 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.291697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.291822 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.292032 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.292123 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.292358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.292510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.292690 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.292784 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-851042-1-iscsi {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.293002 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.293108 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.293329 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.293432 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.293652 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.293758 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.293976 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.294130 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.294237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.294467 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.294572 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.294791 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.294886 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.295116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.295287 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.295428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.295593 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.295739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.295845 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.296049 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.296142 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.296369 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.296515 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.296701 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.296866 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.297007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.297213 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.297479 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.297648 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.297814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.297906 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.298159 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.298313 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.298443 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.298589 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.298756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.298997 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.299101 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.299337 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.299541 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.299629 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.299734 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.144 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.300109 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.300374 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.144 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.300374 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.300649 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.301257 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.301352 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.301524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.301640 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.301838 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.301930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.302143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.302243 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.302471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.302563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.302844 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.302970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.303083 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.303324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.303421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.303504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.303693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.303793 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.304011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.304145 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.304328 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.304447 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.304604 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.304697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.304913 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.305012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.305223 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.305322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.305544 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.305643 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.305855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.305955 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.306166 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.306257 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.306479 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.306577 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.306782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.306875 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.307092 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.307184 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.144 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.307404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.307518 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.144 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.307710 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.307802 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.308018 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.308111 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.308328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.308451 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.308672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.308764 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.308983 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.309074 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.309292 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.309396 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.309603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.309710 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.309912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.310001 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.310224 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.310323 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.310533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.310623 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.310842 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.310939 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.311154 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.311258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.311419 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.311515 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.311726 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.311824 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.312035 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.312125 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.312358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.312488 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.312697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.312801 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.313002 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.313092 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.313313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.313431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.313616 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.313706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.313928 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.314118 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.314272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.314430 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.314573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.314719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.314860 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.315014 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.315161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.315313 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.315460 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.315599 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.315747 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.315884 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.316028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.316195 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.316337 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.316453 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.316659 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.316751 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.316965 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.317065 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.317273 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.317366 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.317577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.317674 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.317884 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.317982 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.318184 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.318302 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.318506 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.318601 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.318819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.318910 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.319126 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.319228 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.319435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.319534 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.319740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.319838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.320048 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.320150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.320371 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.320558 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.320706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.320804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.321020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.321123 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.321343 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.321433 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.321650 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.321747 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.321963 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.322054 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.322286 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.322384 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.322597 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.322687 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.322917 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.323033 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.323218 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.323351 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.323526 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.323719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.323827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.323913 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.324138 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.324246 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.324482 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.324627 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.324806 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.324934 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.325138 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.325273 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.325459 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.325586 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.325778 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.325902 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.326089 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.326205 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.326399 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.326530 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.326707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.326822 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.327030 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 16:31:47.327147 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.327361 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.327558 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.327677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.327788 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.327998 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.328126 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.328336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.329527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.329710 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.329817 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.329912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.329996 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330089 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330180 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330276 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330360 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330442 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330534 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330617 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.330976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.331066 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.331174 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.331318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.331500 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.331644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.331851 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.331990 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.332190 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.332294 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.332543 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.332676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.332887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.332990 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.333284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.333403 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.333844 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.333955 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.334038 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.334110 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.334215 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.334288 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.334500 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.334684 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.334830 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.334969 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.335136 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.335279 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.335427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.335569 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.335717 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.335858 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.336005 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.336151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.336298 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.336473 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.336616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.336797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.336942 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.337118 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.337254 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.337438 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.337586 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.337771 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.337908 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.338114 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.338257 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.338436 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.338578 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.338754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.338891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.339068 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.339210 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.339384 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.339519 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.339700 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.339847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.339995 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.340132 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.340307 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.340524 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.340632 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.340726 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.340943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.341042 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.341275 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.341374 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.341590 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.341688 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.341899 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.341993 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.342226 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.342330 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.342534 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.342626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.342843 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.342934 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.343151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.343249 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.343466 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.343578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.343781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.343890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.344096 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.344210 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.344432 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.344561 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.344756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.344865 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.345062 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.345167 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.345375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.345465 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.345710 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.345798 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.346022 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.346112 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.346341 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.346432 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.346656 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.346753 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.346975 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.347075 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.347287 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.347378 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.348115 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.348205 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.348451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.348557 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.348829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.348941 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.349074 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.349189 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.349381 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.349481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.349695 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.349785 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.350000 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.350103 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.350309 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.350400 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.350614 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.350713 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.350920 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.351020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.351231 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.351323 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.351548 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.351637 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.351856 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.351960 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.352164 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.352257 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.352496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.352607 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.352805 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.352906 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.353128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.353224 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.353517 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.353723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.353956 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.354109 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.354109 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.354381 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.354528 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.354808 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.355051 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.355241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.355241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.355421 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.355503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.355661 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.355803 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.355915 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.356032 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.356361 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.356527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.356649 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.356760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.356872 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.357006 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.357296 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.357609 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.357773 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.357917 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.358070 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.358212 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.358360 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.358509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.358670 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.358815 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.358956 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.359130 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.359287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.359437 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.359598 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.359741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.359882 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.360258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.360633 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.360977 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.361308 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.361635 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.361951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.362273 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.362589 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.362905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.363775 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.364094 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.364439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.364569 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.364801 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.365082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.365396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.365533 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.365723 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.366411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.366572 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.366572 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.366837 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.366972 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.367102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.367260 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.367392 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.367594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.367783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.367922 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.368212 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.368349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.368561 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.368786 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.368932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.369167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.369306 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.369485 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.369714 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.369854 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.370093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.370322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.370454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.370714 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.370853 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.371027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.371236 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.371367 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.371641 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.371777 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.371957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.372153 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.372292 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.372587 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.372896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.373210 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.373348 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.373535 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.373726 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.373942 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.374167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.374488 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.374626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.374794 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.375100 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.375234 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.375422 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.375724 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.375857 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.376026 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.376316 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.376487 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.376655 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.376856 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.376989 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.377300 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.377436 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.377606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.377839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.377978 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.378237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.378374 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.378549 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.378769 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.378920 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.379196 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.379328 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.379543 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.379771 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.379903 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.380177 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.380324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.380469 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.380746 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.380878 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.381072 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.381219 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.381393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.381659 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.381804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.382602 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.382738 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.382882 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.383011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.383146 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.383146 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.383387 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.383527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.383527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.383777 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.383919 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.384258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.384425 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.384680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.384822 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.385089 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.385288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.385428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.385689 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.385868 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.386000 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.386339 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.386478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.386666 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.386839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.387015 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.387552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.387697 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.387883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.388050 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.388182 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.388509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.388643 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.388826 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.389009 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.389148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.389435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.389565 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.389743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.389916 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.390056 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.390354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.390493 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.390658 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.390964 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.391175 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.391316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.391453 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.391582 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.391873 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.392005 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.392185 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.392522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.392658 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.392923 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.393089 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.393223 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.393422 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.393577 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.393719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.394001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.394147 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.394567 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.394712 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.394851 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.394981 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.395229 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.395379 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.395691 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.395837 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.395967 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.396133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.396274 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.396601 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.396766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.396897 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.397069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.397209 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.397468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.397607 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.397834 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.397977 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.398113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.398389 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.398520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.398703 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.398885 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.399025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.399316 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.399456 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.399623 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.399812 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.399944 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.400228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.400373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.400600 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.400866 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.401015 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.401183 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.401401 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.401533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.401782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.401921 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.402095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.402325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.402464 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.402700 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.402831 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.403013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.403237 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.403375 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.403625 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.403756 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.403931 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.404148 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.404281 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.404567 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.404801 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.404936 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.405163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.405317 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.405531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.405718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.405934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.406067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.406191 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.406367 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.406624 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.406856 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.406997 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.407261 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.407407 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.407603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.407755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.407887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.408167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.408299 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.408510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.408679 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.408811 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.409108 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.409247 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.409416 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.409590 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.409722 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.410581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.410731 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.410867 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.411093 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.411236 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.411441 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.411572 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.411748 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.411993 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.412138 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.412346 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.412505 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.412694 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.412930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.413061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.413303 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.413435 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.413610 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.413918 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.414149 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.414289 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.414557 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.414831 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.414980 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.415209 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.415347 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.415592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.415743 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.415873 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.416151 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.416290 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.416491 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.416694 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.416849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.417104 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.417244 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.417426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.417641 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.417787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.418044 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.418223 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.418361 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.418602 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.418738 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.418954 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.419090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.419268 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.419583 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.419766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.419904 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.420120 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.420252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.420552 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.420778 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.420911 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.421131 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.421262 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.421462 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.421610 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.421776 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.422038 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.422176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.422390 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.422518 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.422705 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.422943 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.423074 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.423323 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.423457 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.423638 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.423825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.423964 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.424245 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.424374 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.424660 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.424906 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.425058 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.425196 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.425407 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.425539 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.425858 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.426001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.426219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.426357 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.426497 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.426755 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.426893 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.427125 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.427281 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.427420 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.427680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.427812 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.428087 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.428226 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.428465 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.428607 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.428736 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.429017 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.429154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.429329 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.429509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.429652 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.429950 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.430080 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.430256 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.430461 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.430676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.430927 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.431069 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.431299 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.431495 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.431640 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.431905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.432042 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.432210 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.432443 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.432591 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.432863 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.433003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.433171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.433340 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.433479 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.433769 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.434461 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.434461 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.434728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.434951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.435156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.435298 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.435298 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.435557 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.435686 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.435822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.435951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.436093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.436236 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.436470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.436685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.436824 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.437036 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.437263 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.437491 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.437631 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.437761 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.437927 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.438069 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.438270 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.438401 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.438585 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.438829 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.438968 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.439223 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.439362 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.439538 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.439731 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.439862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.440151 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.440291 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.440500 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.440636 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.440828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.441065 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.441710 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.442178 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.442381 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.442627 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.442848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.443058 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.443203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.443498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.443629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.443926 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.444064 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.444310 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.444493 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.444663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.445010 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.445175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.445382 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.445519 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.445658 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.445868 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.446240 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.446758 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.447065 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.447438 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.447814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.448192 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.448588 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.448962 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.449354 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.449745 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.450135 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.450509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.450890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.451266 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.451640 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.452046 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.452443 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.452816 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.453189 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.453565 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.453940 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.454329 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.454723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.455139 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.455506 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.455882 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.456257 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.456704 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.457643 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.458073 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.458452 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.458852 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.459565 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.459967 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.460099 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.460369 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.460531 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.460727 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.460900 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.461103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.461324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.461466 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.461752 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.461892 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.462051 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.462423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.462566 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.462696 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.462823 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.463018 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.463163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.463335 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.463561 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.463710 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.464038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.464195 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.464341 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.464581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.464714 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.464964 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.465370 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.465524 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.465727 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.465727 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.465971 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.466097 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.466232 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.466368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.466574 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.466890 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.467227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.467532 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.478793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.478793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.478793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.478793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.478793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.478793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.478793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.478793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.480631 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.480631 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.480631 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.480631 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.480631 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.480631 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.480631 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.480631 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.481957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.481957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.481957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.481957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.481957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.481957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.481957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.481957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.483168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.483168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.483168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.483168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.483168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.483168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.483168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.483168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.484158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.484158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.484158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.484158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.484158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.484158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.484158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.484158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.485428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.485428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.485428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.485428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.485428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.485428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.485428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.486410 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.486554 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.486554 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.486554 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.487025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.487227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.487227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.487483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.487619 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.487619 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.487871 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.488014 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.492608 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.492752 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.492752 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.493010 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.493158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.493158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.493427 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.493563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.493700 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.493828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.493828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.494087 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.494216 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.494216 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.494216 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.494589 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.494893 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.495668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.495804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.495932 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.496062 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.496201 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.496331 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.496475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.496604 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.496732 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.496859 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.497016 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.497249 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.497472 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.497596 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.497705 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.497808 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.497934 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.498066 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.498202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.498332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.498332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.498332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.498332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.498332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.498332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.498332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.498332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.499285 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.499285 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.499541 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.499670 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.499797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.499943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.499943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.499943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.499943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.500478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.500609 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.500755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.500892 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.500892 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.500892 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.500892 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.501379 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.501515 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.501515 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.501774 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.501902 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.501902 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.502143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.502294 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.502520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.502817 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.502817 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.503063 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.503205 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.503341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.503472 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.503472 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.504468 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.504605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.504605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.504876 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.505150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.505150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.505418 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.505548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.505685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.505814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.505814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.506072 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.506209 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.506209 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.506460 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.506597 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.506735 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.506865 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.506865 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.507128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.507343 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.507343 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.507666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.507797 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.507797 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.508047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.508176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.508305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.508457 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.508457 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.508714 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.508852 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.508981 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.509107 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.509242 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.509532 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.509672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.509849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.510042 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.510183 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.510455 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.510654 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.510795 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.511066 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.511204 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.511373 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.511577 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.511717 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.512035 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.512196 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.512717 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.512999 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.513148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.513286 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.513424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.513555 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.513839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.513982 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.514262 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.514399 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.514580 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.514811 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.514951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.515244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.515392 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.515601 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.515734 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.516093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.516235 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.516461 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.516653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.516796 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.517114 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.517246 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.517458 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.517618 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.517837 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.518039 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.518173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.518348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.518541 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.518674 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.518979 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.519119 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.519434 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.519610 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.519744 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.519934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.520076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.520250 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.520494 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.520644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.520904 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.521099 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.521244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.521528 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.521666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.521842 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.522049 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.522181 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.522454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.522593 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.522820 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.523114 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.523297 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.523445 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.523583 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.523713 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.523897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.524029 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.524326 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.524511 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.524671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.524985 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.525123 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.525389 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.525525 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.525667 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.525914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.526051 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.526206 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.526467 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.526607 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.526839 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.526970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.527150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.527405 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.527614 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.527870 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.528012 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.528192 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.528322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.528543 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.528776 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.528921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.529166 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.529305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.529491 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.529715 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.529855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.530115 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.530253 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.530429 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.530649 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.530782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.531085 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.531224 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.531414 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.531605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.531745 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.532041 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.532180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.532349 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.532571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.532703 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.532983 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.533268 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.533415 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.533555 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.533685 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.533897 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.534029 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.534203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.534404 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.534545 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.534816 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.535072 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.535215 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.535495 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.535630 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.535759 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.536002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.536143 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.536309 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.536566 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.536707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.536932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.537071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.537238 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.537486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.537644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.537930 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.538187 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.538333 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.538463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.538601 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.538756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.538940 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.539070 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.539356 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.539495 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.539662 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.539879 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.540012 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.540315 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.540470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.540660 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.540822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.540986 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.541280 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.541414 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.541621 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.541757 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.541934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.542188 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.542330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.542568 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.542706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.542887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.543115 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.543400 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.543534 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.543663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.543820 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.544004 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.544144 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.544454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.544599 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.544772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.545057 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.545208 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.545389 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.545645 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.545777 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.545994 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.546127 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.546331 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.546485 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.546666 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.546926 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.547059 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.547285 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.547423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.547603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.547831 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.548036 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.548249 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.548434 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.548580 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.548819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.548960 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.549705 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.549847 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.549977 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.550113 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.550322 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.550322 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.551092 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.551217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.551217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.551461 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.551602 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.551825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.552127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.552354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.552529 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.552671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.552818 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.553164 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.553305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.553635 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.553773 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.553914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.554078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.554210 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.554428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.554559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.554761 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.555178 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.555328 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.555466 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.555763 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.555899 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.555899 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124820) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 16:31:47.556169 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.557217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.557217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.557217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.557636 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.558297 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.559211 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.559211 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.559492 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.560019 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.560164 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.560589 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.560981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.561377 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.561766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.562157 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.562569 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.562981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.563383 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.563798 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.564202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.564678 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.565043 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.565519 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.565902 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.566290 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.567121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.567452 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.567785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.568114 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.568462 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.568784 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.569111 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.569436 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.569758 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.570078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.570402 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.570727 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.571062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.571410 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.571742 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.572066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.572409 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.572742 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.573297 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.573624 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.573969 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.574304 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.574637 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.574980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.575295 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.575635 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.575952 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.576267 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.576611 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.576935 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.577250 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.577584 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.577905 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.578220 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.578554 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.578871 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.579412 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.579773 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.580095 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.580452 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.580788 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.581117 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.581435 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.581769 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.582108 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.582423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.582750 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.583070 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.583384 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.583699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.584021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.584339 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.584692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.585020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.585334 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.585670 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.586002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.586302 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.586611 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.586930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.587242 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.587604 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.587928 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.588285 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.588652 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.588939 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.589273 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.589587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.589908 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.590222 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.590542 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.590937 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.591236 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.591552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.591865 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.592193 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.592659 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.592993 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.593312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.593629 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.594211 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.594541 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.595105 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.595452 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.595783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.596127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.597346 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.597346 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.597346 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.598036 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.598036 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.598448 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.598604 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.598876 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.599205 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.599529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.599852 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.600173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.600525 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.600850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.601170 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.601490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.601808 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.602128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.602454 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.602803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.603132 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.603460 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.603788 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.604115 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.604453 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.604775 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.605098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.605415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.605740 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.606077 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.606401 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.606718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.607154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.607475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.607804 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.608137 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.608488 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.608807 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.609140 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.609458 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.609787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.610106 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.610442 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.610790 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.611136 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.611459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.611771 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.612085 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.612414 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.612739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.613589 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.613916 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.614229 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.614541 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.614860 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.615180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.615492 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.615817 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.616115 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.616452 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.616765 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.617076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.617388 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.617700 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.618012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.618324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.618641 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.618953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.619268 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.619581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.619756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO dbcounter [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Registered counter for database nova_api Jul 26 16:31:47.619893 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.620203 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.620570 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.620913 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.621236 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.621568 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.621887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.622216 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.622532 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.622862 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.623188 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.623512 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.623831 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.624173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.624588 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.624916 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.625235 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.625555 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.625872 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.626192 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.626529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.626864 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.627178 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.627510 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.627836 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.628164 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.628509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.629415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.629752 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.630070 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.630388 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.630703 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.631020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.631338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.631659 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.631976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.632293 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.632639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.632965 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.633299 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.633632 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.633950 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.634281 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.634614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.634974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.635297 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.635652 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.635989 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.636473 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.636830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.637071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 16:31:47.638497 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124821) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 16:31:47.641030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:31:47.647753 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writer thread running {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:31:47.700180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO dbcounter [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Registered counter for database nova_api Jul 26 16:31:47.704557 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.context [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),499fcfc6-ab87-45d5-8d28-bf683a10ff8a(cell1) {{(pid=124820) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 16:31:47.709352 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:31:47.710283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:31:47.711097 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:31:47.713408 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:31:47.715414 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO dbcounter [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Registered counter for database nova_cell0 Jul 26 16:31:47.719795 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO dbcounter [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Registered counter for database nova_cell1 Jul 26 16:31:47.720108 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_db.sqlalchemy.engines [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:31:47.727467 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:31:47.728913 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writer thread running {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:31:47.730283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:31:47.734112 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writer thread running {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:31:47.790182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.context [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),499fcfc6-ab87-45d5-8d28-bf683a10ff8a(cell1) {{(pid=124821) load_cells /opt/stack/nova/nova/context.py:464}} Jul 26 16:31:47.794378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:31:47.795992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:31:47.796839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:31:47.799118 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:31:47.801654 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO dbcounter [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Registered counter for database nova_cell0 Jul 26 16:31:47.805675 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO dbcounter [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Registered counter for database nova_cell1 Jul 26 16:31:47.812900 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_db.sqlalchemy.engines [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:31:47.814186 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_db.sqlalchemy.engines [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:31:47.821442 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writer thread running {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:31:47.822739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writer thread running {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:31:47.875720 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writer thread running {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:31:47.886274 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO dbcounter [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Registered counter for database nova_cell0 Jul 26 16:31:47.893047 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_db.sqlalchemy.engines [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124820) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:31:47.897433 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writer thread running {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:31:47.969721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO dbcounter [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Registered counter for database nova_cell0 Jul 26 16:31:47.978080 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_db.sqlalchemy.engines [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124821) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 16:31:47.982614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writer thread running {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 16:31:48.222036 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: WARNING keystonemiddleware.auth_token [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 16:31:48.229777 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: WARNING keystonemiddleware.auth_token [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 16:31:48.304574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: WARNING keystonemiddleware.auth_token [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 16:31:48.311814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: WARNING keystonemiddleware.auth_token [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 16:31:48.571383 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: WARNING keystonemiddleware.auth_token [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 16:31:48.577767 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: WARNING keystonemiddleware.auth_token [None req-f7ade9eb-dbda-4392-b6f4-9f7e03f3718d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 16:31:48.583331 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561634c0b9c0 pid: 124820 (default app) Jul 26 16:31:48.666568 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: WARNING keystonemiddleware.auth_token [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 26 16:31:48.672644 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: WARNING keystonemiddleware.auth_token [None req-e6755f5c-4e52-4ca0-b34b-9cf157209cf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 26 16:31:48.679313 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561634c0b9c0 pid: 124821 (default app) Jul 26 16:32:30.613048 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=3 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:32:30.614492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=3 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:32:30.615038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=3 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:32:30.616191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=3 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:32:30.741035 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=3 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:32:30.742816 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=3 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:32:30.743776 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=3 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:32:30.744635 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=3 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:32:31.813813 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1a68e594-d4b9-4258-8cac-e475992156a2 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Action: 'create', calling method: .version_select at 0x7f4b6d915940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1240823743"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:31.945438 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6597a3dc-d6b0-41c7-b357-870f7fd67ac9 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Action: 'create', calling method: .version_select at 0x7f4b6d916940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1426073963", "metadata": {"Type": "work"}}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:33.466781 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1a68e594-d4b9-4258-8cac-e475992156a2 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.730700 Jul 26 16:32:33.467433 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 1/1] 10.222.0.144 () {60 vars in 1160 bytes} [Tue Jul 26 16:32:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2733 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jul 26 16:32:33.647087 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e71a8503-2a6b-44e8-b08e-22e47a7b3460 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Action: 'create', calling method: .version_select at 0x7f4b6d76c700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1854174385", "metadata": {"Type": "work"}}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e71a8503-2a6b-44e8-b08e-22e47a7b3460 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Request method failure captured: Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 122 Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BceaFt7nBnbWebGynlNUaUDa61SHPgd5Ia0okj0M39F_kRW8bRHq-bVqfPkHNMHCWCr0Sp3Izu86JdHdcDWNOi7D4Pywz_PxxaOftcS9xmlAfHFcEt_qGeXIG5BewMLsQ6IOBAzKy8OSHo2bimlydik4HvIaN5Z5h3QMgDuDjwitV0 Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:32:33.652424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bf096b68d664989bbb0a08e0b5c4e4e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: e4f115425e784615aa55c1c6a3a60aac Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1854174385", "metadata": {"Type": "work"}}} Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: Jul 26 16:32:33.653850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1854174385', 'metadata': {'Type': 'work'}}}} Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise error Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi '#$%' Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:33.654976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 16:32:33.656489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 16:32:33.659282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 26 16:32:33.659282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.659282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e71a8503-2a6b-44e8-b08e-22e47a7b3460 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:33.659282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e71a8503-2a6b-44e8-b08e-22e47a7b3460 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] 10.222.0.144 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.185501 Jul 26 16:32:33.659282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 2/2] 10.222.0.144 () {60 vars in 1161 bytes} [Tue Jul 26 16:32:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 16:32:33.661673 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-559474b8-fb3b-4cd6-8719-931edd9caafd tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d73e160>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:33.714276 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-559474b8-fb3b-4cd6-8719-931edd9caafd tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b" status: 200 len: 345 microversion: 2.1 time: 0.057132 Jul 26 16:32:33.714766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 3/3] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:33 2022] GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:33.721536 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-41abec31-e17f-403f-b7ed-e70e553cf37b tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Action: 'create', calling method: .version_select at 0x7f4b6d780ca0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-721519129", "metadata": {"Type": "work"}}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-41abec31-e17f-403f-b7ed-e70e553cf37b tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Request method failure captured: Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 119 Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BceaFt7nBnbWebGynlNUaUDa61SHPgd5Ia0okj0M39F_kRW8bRHq-bVqfPkHNMHCWCr0Sp3Izu86JdHdcDWNOi7D4Pywz_PxxaOftcS9xmlAfHFcEt_qGeXIG5BewMLsQ6IOBAzKy8OSHo2bimlydik4HvIaN5Z5h3QMgDuDjwitV0 Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:32:33.727194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bf096b68d664989bbb0a08e0b5c4e4e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: e4f115425e784615aa55c1c6a3a60aac Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-721519129", "metadata": {"Type": "work"}}} Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: Jul 26 16:32:33.728686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-721519129', 'metadata': {'Type': 'work'}}}} Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise error Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi '0' Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:33.729481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 16:32:33.730677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 16:32:33.731706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 26 16:32:33.731706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.731706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-41abec31-e17f-403f-b7ed-e70e553cf37b tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:33.731706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-41abec31-e17f-403f-b7ed-e70e553cf37b tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] 10.222.0.144 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012292 Jul 26 16:32:33.731706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 4/4] 10.222.0.144 () {60 vars in 1161 bytes} [Tue Jul 26 16:32:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 16:32:33.740649 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fa99b5e1-46cd-4232-9bc6-6d7f9d922426 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Action: 'create', calling method: .version_select at 0x7f4b6d73e430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-748812347", "metadata": {"Type": "work"}}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fa99b5e1-46cd-4232-9bc6-6d7f9d922426 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Request method failure captured: Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 118 Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BceaFt7nBnbWebGynlNUaUDa61SHPgd5Ia0okj0M39F_kRW8bRHq-bVqfPkHNMHCWCr0Sp3Izu86JdHdcDWNOi7D4Pywz_PxxaOftcS9xmlAfHFcEt_qGeXIG5BewMLsQ6IOBAzKy8OSHo2bimlydik4HvIaN5Z5h3QMgDuDjwitV0 Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:32:33.744182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bf096b68d664989bbb0a08e0b5c4e4e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: e4f115425e784615aa55c1c6a3a60aac Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-748812347", "metadata": {"Type": "work"}}} Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: Jul 26 16:32:33.745580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-748812347', 'metadata': {'Type': 'work'}}}} Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise error Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi '' Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:33.746345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 26 16:32:33.749270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 26 16:32:33.751480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 26 16:32:33.751480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:33.751480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fa99b5e1-46cd-4232-9bc6-6d7f9d922426 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:33.751480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fa99b5e1-46cd-4232-9bc6-6d7f9d922426 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] 10.222.0.144 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010982 Jul 26 16:32:33.751480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 5/5] 10.222.0.144 () {60 vars in 1161 bytes} [Tue Jul 26 16:32:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 16:32:33.759086 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4d66bcbe-fbf1-4fcb-a058-025b89ca37c9 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Calling method '.version_select at 0x7f4b6e13edc0>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-4d66bcbe-fbf1-4fcb-a058-025b89ca37c9 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] HTTP exception thrown: Volume tempest-invalid-1731523750 could not be found. Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4d66bcbe-fbf1-4fcb-a058-025b89ca37c9 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Request method failure captured: Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1731523750 HTTP/1.1 Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BceaFt7nBnbWebGynlNUaUDa61SHPgd5Ia0okj0M39F_kRW8bRHq-bVqfPkHNMHCWCr0Sp3Izu86JdHdcDWNOi7D4Pywz_PxxaOftcS9xmlAfHFcEt_qGeXIG5BewMLsQ6IOBAzKy8OSHo2bimlydik4HvIaN5Z5h3QMgDuDjwitV0 Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:32:34.125305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bf096b68d664989bbb0a08e0b5c4e4e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: e4f115425e784615aa55c1c6a3a60aac Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Volume tempest-invalid-1731523750 could not be found. Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': 'tempest-invalid-1731523750'} Jul 26 16:32:34.129154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1731523750 could not be found. (HTTP 404) (Request-ID: req-e067ed41-d364-4b9c-843f-4f3d484b90f7) Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:34.133984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 16:32:34.136471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1731523750 could not be found. Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:32:34.141127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1731523750 could not be found. Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1731523750 could not be found. Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4d66bcbe-fbf1-4fcb-a058-025b89ca37c9 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Returning 404 to user: Volume tempest-invalid-1731523750 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4d66bcbe-fbf1-4fcb-a058-025b89ca37c9 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] 10.222.0.144 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1731523750" status: 404 len: 99 microversion: 2.1 time: 0.060343 Jul 26 16:32:34.143739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 6/6] 10.222.0.144 () {58 vars in 1223 bytes} [Tue Jul 26 16:32:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1731523750 => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 26 16:32:34.145814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fd6de6b2-b386-4be8-b0b9-24736bac0a5a tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] 10.222.0.144 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004543 Jul 26 16:32:34.145814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 7/7] 10.222.0.144 () {58 vars in 1145 bytes} [Tue Jul 26 16:32:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 16:32:34.145814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-090ed1de-0763-456f-b97d-3e933486049b tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004437 Jul 26 16:32:34.145814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 8/8] 10.222.0.144 () {58 vars in 1142 bytes} [Tue Jul 26 16:32:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 26 16:32:34.145814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e04fcf42-0ea0-4179-ad70-1ce814bf8e41 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Calling method '.version_select at 0x7f4b6d73e160>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:34.145814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-e04fcf42-0ea0-4179-ad70-1ce814bf8e41 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] HTTP exception thrown: Volume 516208fc-52b6-40dd-ad25-c0376063ea01 could not be found. Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e04fcf42-0ea0-4179-ad70-1ce814bf8e41 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Request method failure captured: Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: DELETE /compute/v2.1/os-volumes/516208fc-52b6-40dd-ad25-c0376063ea01 HTTP/1.1 Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BceaFt7nBnbWebGynlNUaUDa61SHPgd5Ia0okj0M39F_kRW8bRHq-bVqfPkHNMHCWCr0Sp3Izu86JdHdcDWNOi7D4Pywz_PxxaOftcS9xmlAfHFcEt_qGeXIG5BewMLsQ6IOBAzKy8OSHo2bimlydik4HvIaN5Z5h3QMgDuDjwitV0 Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:32:34.147785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bf096b68d664989bbb0a08e0b5c4e4e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: e4f115425e784615aa55c1c6a3a60aac Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Volume 516208fc-52b6-40dd-ad25-c0376063ea01 could not be found. Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '516208fc-52b6-40dd-ad25-c0376063ea01'} Jul 26 16:32:34.150375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 516208fc-52b6-40dd-ad25-c0376063ea01 could not be found. (HTTP 404) (Request-ID: req-ecdf694e-d037-45b8-b5c0-68dcee111b80) Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:34.151596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 16:32:34.154263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 516208fc-52b6-40dd-ad25-c0376063ea01 could not be found. Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 16:32:34.155842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 516208fc-52b6-40dd-ad25-c0376063ea01 could not be found. Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 516208fc-52b6-40dd-ad25-c0376063ea01 could not be found. Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e04fcf42-0ea0-4179-ad70-1ce814bf8e41 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Returning 404 to user: Volume 516208fc-52b6-40dd-ad25-c0376063ea01 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e04fcf42-0ea0-4179-ad70-1ce814bf8e41 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] 10.222.0.144 "DELETE /compute/v2.1/os-volumes/516208fc-52b6-40dd-ad25-c0376063ea01" status: 404 len: 109 microversion: 2.1 time: 0.048852 Jul 26 16:32:34.158069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 9/9] 10.222.0.144 () {58 vars in 1253 bytes} [Tue Jul 26 16:32:33 2022] DELETE /compute/v2.1/os-volumes/516208fc-52b6-40dd-ad25-c0376063ea01 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cd49ad44-98f7-4b43-b506-0d5f89d8f9c7 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Calling method '.version_select at 0x7f4b6d73edc0>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-cd49ad44-98f7-4b43-b506-0d5f89d8f9c7 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] HTTP exception thrown: Volume c311cbfc-c568-475a-b831-4712a586f3b5 could not be found. Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cd49ad44-98f7-4b43-b506-0d5f89d8f9c7 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Request method failure captured: Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/os-volumes/c311cbfc-c568-475a-b831-4712a586f3b5 HTTP/1.1 Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BceaFt7nBnbWebGynlNUaUDa61SHPgd5Ia0okj0M39F_kRW8bRHq-bVqfPkHNMHCWCr0Sp3Izu86JdHdcDWNOi7D4Pywz_PxxaOftcS9xmlAfHFcEt_qGeXIG5BewMLsQ6IOBAzKy8OSHo2bimlydik4HvIaN5Z5h3QMgDuDjwitV0 Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:32:34.159988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bf096b68d664989bbb0a08e0b5c4e4e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bf096b68d664989bbb0a08e0b5c4e4e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bf096b68d664989bbb0a08e0b5c4e4e Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-VolumesNegativeTest-1699573737 Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: e4f115425e784615aa55c1c6a3a60aac Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-VolumesNegativeTest-1699573737-project Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Volume c311cbfc-c568-475a-b831-4712a586f3b5 could not be found. Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': 'c311cbfc-c568-475a-b831-4712a586f3b5'} Jul 26 16:32:34.163047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c311cbfc-c568-475a-b831-4712a586f3b5 could not be found. (HTTP 404) (Request-ID: req-834b7a0a-7473-44e4-bd32-7c19aec16283) Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:34.164855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 16:32:34.167133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c311cbfc-c568-475a-b831-4712a586f3b5 could not be found. Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 16:32:34.169514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c311cbfc-c568-475a-b831-4712a586f3b5 could not be found. Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c311cbfc-c568-475a-b831-4712a586f3b5 could not be found. Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cd49ad44-98f7-4b43-b506-0d5f89d8f9c7 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] Returning 404 to user: Volume c311cbfc-c568-475a-b831-4712a586f3b5 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-cd49ad44-98f7-4b43-b506-0d5f89d8f9c7 tempest-VolumesNegativeTest-1699573737 tempest-VolumesNegativeTest-1699573737-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/c311cbfc-c568-475a-b831-4712a586f3b5" status: 404 len: 109 microversion: 2.1 time: 0.043934 Jul 26 16:32:34.172595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 10/10] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:33 2022] GET /compute/v2.1/os-volumes/c311cbfc-c568-475a-b831-4712a586f3b5 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:32:34.537255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6597a3dc-d6b0-41c7-b357-870f7fd67ac9 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.931839 Jul 26 16:32:34.539611 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 1/11] 10.222.0.144 () {60 vars in 1161 bytes} [Tue Jul 26 16:32:30 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3936 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jul 26 16:32:34.560984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-10fcefb8-fd2c-4413-8850-c83eeb7bbe10 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d73e1f0>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:34.689266 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-10fcefb8-fd2c-4413-8850-c83eeb7bbe10 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.134434 Jul 26 16:32:34.690007 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 11/12] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:34 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:34.728901 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2bd94f45-6dea-4d83-8a22-4c249a269e95 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d76c790>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:34.827329 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2bd94f45-6dea-4d83-8a22-4c249a269e95 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b" status: 200 len: 345 microversion: 2.1 time: 0.102881 Jul 26 16:32:34.832752 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 2/13] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:34 2022] GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b => generated 345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:35.703558 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5d993c10-af39-43b3-8111-dd6ea067cc73 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d73ed30>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:35.841268 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5d993c10-af39-43b3-8111-dd6ea067cc73 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.134056 Jul 26 16:32:35.841268 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 12/14] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:35 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:35.846752 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fe41882d-8b8a-4d30-b763-24f48652e766 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d76cee0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:35.944868 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fe41882d-8b8a-4d30-b763-24f48652e766 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b" status: 200 len: 346 microversion: 2.1 time: 0.101805 Jul 26 16:32:35.945427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 3/15] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:35 2022] GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b => generated 346 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:35.964694 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-59e559c2-5233-4ad3-9981-79aedf15cdf1 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Action: 'create', calling method: .version_select at 0x7f4b6d76c550>, body: {"snapshot": {"volume_id": "84f70324-874c-4f8a-852b-8f803f89d02b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2059469255"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:36.822465 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-59e559c2-5233-4ad3-9981-79aedf15cdf1 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.860963 Jul 26 16:32:36.826829 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 13/16] 10.222.0.144 () {60 vars in 1167 bytes} [Tue Jul 26 16:32:35 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:36.843304 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-76cdf4a5-0924-40ab-8e34-9203db36e66d tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d77e5e0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:36.884717 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3dd88154-a81f-4d40-903b-a09544592ba6 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d70ce50>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:37.015919 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-76cdf4a5-0924-40ab-8e34-9203db36e66d tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.179957 Jul 26 16:32:37.018293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 4/17] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:36 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:32:37.030776 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5fd949e7-4612-42bc-9ba9-c5f0d7ca85a9 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d76cc10>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:37.176139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5fd949e7-4612-42bc-9ba9-c5f0d7ca85a9 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.140281 Jul 26 16:32:37.176139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 5/18] 10.222.0.144 () {58 vars in 1145 bytes} [Tue Jul 26 16:32:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:32:37.180499 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-487a7ab1-0bf9-488f-a741-2cdd2a20f6ae tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d77e9d0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:37.193053 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3dd88154-a81f-4d40-903b-a09544592ba6 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 354 microversion: 2.1 time: 0.345618 Jul 26 16:32:37.194250 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 14/19] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:36 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 354 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:37.219343 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3cd088d4-8f8a-4398-845a-46bfecdc69e7 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d70cca0>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:37.258677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-487a7ab1-0bf9-488f-a741-2cdd2a20f6ae tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.082216 Jul 26 16:32:37.266972 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 6/20] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:37 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:32:37.557097 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3cd088d4-8f8a-4398-845a-46bfecdc69e7 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 354 microversion: 2.1 time: 0.347243 Jul 26 16:32:37.557850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 15/21] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:37 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 354 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:32:37.586072 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-313d2233-a3d6-4f1f-a5ed-02d1588f3add tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d78c160>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:38.028814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-313d2233-a3d6-4f1f-a5ed-02d1588f3add tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "DELETE /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 202 len: 0 microversion: 2.1 time: 0.455740 Jul 26 16:32:38.029368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 7/22] 10.222.0.144 () {58 vars in 1253 bytes} [Tue Jul 26 16:32:37 2022] DELETE /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:32:38.038030 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6d260069-6ba7-40a4-8852-28a48ea55a1e tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d70c550>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:38.160871 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6d260069-6ba7-40a4-8852-28a48ea55a1e tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.127296 Jul 26 16:32:38.166932 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 16/23] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:38 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:38.273079 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-71fafa60-3204-479a-a1a7-ae6971ef042f tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d76c940>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:38.346378 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-71fafa60-3204-479a-a1a7-ae6971ef042f tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.072565 Jul 26 16:32:38.346378 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 8/24] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:38 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:39.174606 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-33d33f3d-de3c-49d3-90fe-ffaaf26bc6dd tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d76cb80>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:39.283211 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-33d33f3d-de3c-49d3-90fe-ffaaf26bc6dd tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.112442 Jul 26 16:32:39.284231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 17/25] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:39 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:39.354294 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c3449e46-2252-44b0-aff4-ad3fcfeb9caf tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d77ee50>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:39.430404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c3449e46-2252-44b0-aff4-ad3fcfeb9caf tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.079845 Jul 26 16:32:39.431040 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 9/26] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:39 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:40.298235 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9ad6d592-36a5-44d6-838a-7a705bea8106 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d73ec10>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:40.409116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9ad6d592-36a5-44d6-838a-7a705bea8106 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.115108 Jul 26 16:32:40.410225 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 18/27] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:40 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:32:40.443782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-098e9cb3-17d3-4104-b7cd-39a04115c921 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d77e1f0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:40.507235 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-098e9cb3-17d3-4104-b7cd-39a04115c921 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.065764 Jul 26 16:32:40.512886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 10/28] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:40 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:41.368486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6444ebde-74fd-48ca-9f43-baf0cba48ce4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: .version_select at 0x7f4b6d76cc10>, body: {"keypair": {"name": "tempest-keypair-1902753241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOpy1Exum58XQJ7RWcCC25MgCF5SLjPk8L9xzoqLsn7a3CjobvrffkeWvpJiFOvpWNIv+xtf+QH8snmJsVtWKs1JOsyRSasyopMbpOtYN0b3kufWw8to6VdFk4zqxssUfQ=="}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:41.424607 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-05aed05c-0b5f-44ca-b76a-ed9ef0f60dbe tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d76cca0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:41.490350 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-6444ebde-74fd-48ca-9f43-baf0cba48ce4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for project 8bb1d794693b410d8c759796d5e20281. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:32:41.500826 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-6444ebde-74fd-48ca-9f43-baf0cba48ce4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for user 4c6fffcc3c0d4c49848fa6c2f6b90130 and project 8bb1d794693b410d8c759796d5e20281. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:32:41.519850 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-05aed05c-0b5f-44ca-b76a-ed9ef0f60dbe tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.100579 Jul 26 16:32:41.520694 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 11/29] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:41 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:41.525283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-92cfb114-ea5d-4d65-9370-3311a97e21fa tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d77e940>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:41.588898 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-92cfb114-ea5d-4d65-9370-3311a97e21fa tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.066566 Jul 26 16:32:41.589735 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 12/30] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:41 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:41.754977 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6444ebde-74fd-48ca-9f43-baf0cba48ce4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.674968 Jul 26 16:32:41.756322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 19/31] 10.222.0.144 () {60 vars in 1164 bytes} [Tue Jul 26 16:32:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:42.538316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-16704363-ef18-4953-b7e7-f356ae76a454 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d77ea60>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:42.601645 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8c606986-941d-4095-8407-30baed5281f9 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d6865e0>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:42.654961 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8c606986-941d-4095-8407-30baed5281f9 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.057817 Jul 26 16:32:42.659036 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-16704363-ef18-4953-b7e7-f356ae76a454 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.128865 Jul 26 16:32:42.666029 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 20/32] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:42 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:32:42.666307 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 13/33] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:42 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:43.672985 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-079c4f24-5757-4701-b19c-5bceee788dd4 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d77e5e0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:43.677506 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5bcfd85e-ab7f-405a-b440-a718cca8b23d tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d686ca0>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:43.765075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5bcfd85e-ab7f-405a-b440-a718cca8b23d tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.097040 Jul 26 16:32:43.765647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 21/34] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:43 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:43.805450 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-079c4f24-5757-4701-b19c-5bceee788dd4 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.136097 Jul 26 16:32:43.806030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 14/35] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:43 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:44.785961 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-66d19185-aacc-4a45-8d5c-3f1b57715b77 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d686a60>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:44.825653 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d13bc460-5bd0-44df-bcde-98b8d16845b6 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d77ee50>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:44.856767 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-66d19185-aacc-4a45-8d5c-3f1b57715b77 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.082512 Jul 26 16:32:44.857345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 22/36] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:44 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:45.285503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d13bc460-5bd0-44df-bcde-98b8d16845b6 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.463989 Jul 26 16:32:45.286638 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 15/37] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:44 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:45.490858 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1077396667", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:45.683049 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] validate_networks() for [('75185dc6-2be4-492f-849d-964d05de909f', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:32:45.869196 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-13be82d9-ebef-4c7d-8527-074647578ed7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d77e280>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:45.946827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-13be82d9-ebef-4c7d-8527-074647578ed7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.081340 Jul 26 16:32:45.947388 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 16/38] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:45 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:32:46.300198 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3a121a44-622b-4268-9738-d7488df051c1 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d76c670>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:46.416889 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3a121a44-622b-4268-9738-d7488df051c1 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.121093 Jul 26 16:32:46.418036 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 17/39] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:46 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:46.968454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3ab11adb-3985-4b81-91c2-f35f2b990b45 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6d76cee0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:47.034257 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3ab11adb-3985-4b81-91c2-f35f2b990b45 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.078977 Jul 26 16:32:47.037370 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 18/40] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:46 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:47.433877 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7a5a2a14-3887-492d-a606-e47dcb997d09 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6d76c8b0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:47.558337 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7a5a2a14-3887-492d-a606-e47dcb997d09 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.130309 Jul 26 16:32:47.560334 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 19/41] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:47 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:47.751033 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-335f777b-7737-467c-9d61-d51248824331 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'create', calling method: .version_select at 0x7f4b6d9169d0>, body: {"keypair": {"name": "tempest-keypair-156862295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+eY+dMVBKdh/m6WawrhJ+q9K9HlTetHK4kag+8Nninj/6usf1b1W6mDcrQdA42XjnBfPNRprzTqHKVGrs98SNpsbCa4jfOVocKZkr2VJVUpF1rM3OOQcJwZQfA6hpShg=="}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:47.805323 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-335f777b-7737-467c-9d61-d51248824331 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Getting quotas for project 4088561009754a839604e3798787d8b9. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:32:47.818762 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-335f777b-7737-467c-9d61-d51248824331 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Getting quotas for user 1b9d76409f834b478981c0bbc0c3d4b6 and project 4088561009754a839604e3798787d8b9. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:32:47.990171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-335f777b-7737-467c-9d61-d51248824331 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.426743 Jul 26 16:32:48.000022 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 20/42] 10.222.0.144 () {60 vars in 1164 bytes} [Tue Jul 26 16:32:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:48.086139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1558427021", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "networks": [{"uuid": "0ad0ac4b-b585-4675-b48d-bc4995419358"}]}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:48.216710 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.network.neutron [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] validate_networks() for [('0ad0ac4b-b585-4675-b48d-bc4995419358', None, None, None, None, None)] {{(pid=124820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:32:48.290546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:32:48.291664 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:32:48.292286 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:32:48.293505 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:32:48.294154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:32:48.310606 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:48.312151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:48.313225 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:48.313812 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:48.348553 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Getting quotas for project 08a954085f8f454698c55faa9351ad6e. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:32:48.353427 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Getting quotas for user 07e70b1c968443eab469777283b8fb50 and project 08a954085f8f454698c55faa9351ad6e. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:32:48.370059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:32:48.373350 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:32:48.651448 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-955fcf1b-3ec4-4829-bbe8-5243e110ec5b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 3.282072 Jul 26 16:32:48.652102 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 23/43] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:32:45 2022] POST /compute/v2.1/servers => generated 385 bytes in 3285 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:32:48.662305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-47da737b-a9ec-4cb1-9cef-98d8d5f4644f tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6ce0df70>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:48.712056 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-47da737b-a9ec-4cb1-9cef-98d8d5f4644f tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 288 microversion: 2.1 time: 0.058385 Jul 26 16:32:48.713208 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 24/44] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:48 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 288 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:48.720032 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-676361c0-fdf8-4195-acc6-242f8498e064 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6cdc0700>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:48.815629 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-676361c0-fdf8-4195-acc6-242f8498e064 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.098998 Jul 26 16:32:48.815629 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 25/45] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:48 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:48.819465 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e06c4d3e-adfe-4216-b358-611368bda142 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:48.820264 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e06c4d3e-adfe-4216-b358-611368bda142 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:48.988828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e06c4d3e-adfe-4216-b358-611368bda142 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:49.015544 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e06c4d3e-adfe-4216-b358-611368bda142 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1226 microversion: 2.1 time: 0.200070 Jul 26 16:32:49.016211 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 26/46] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:48 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1226 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:49.045591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-31483199-7323-4064-ada9-655dd81fe4ff tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6cdc0160>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:49.232216 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Flavor limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:32:49.232832 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Image limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:32:49.233476 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Flavor pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:32:49.234048 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Image pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:32:49.234995 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:32:49.259065 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:49.259065 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:49.259065 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:49.259338 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:49.308797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-31483199-7323-4064-ada9-655dd81fe4ff tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "DELETE /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 202 len: 0 microversion: 2.1 time: 0.268810 Jul 26 16:32:49.312805 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 27/47] 10.222.0.144 () {58 vars in 1259 bytes} [Tue Jul 26 16:32:49 2022] DELETE /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:32:49.319849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-209409748", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fec62f0-42f9-4a76-8f36-14730e310aa9"}], "security_groups": [{"name": "tempest-securitygroup--1619218992"}], "key_name": "tempest-keypair-1902753241", "user_data": "}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:49.369520 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Getting quotas for project 940d1a5ec6514d18946628b99f16a96e. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:32:49.374401 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Getting quotas for user db18d0211f2a4e1c8949726ded7a9bb3 and project 940d1a5ec6514d18946628b99f16a96e. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:32:49.390082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Going to run 1 instances... {{(pid=124820) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:32:49.393003 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:32:49.512228 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] validate_networks() for [('7fec62f0-42f9-4a76-8f36-14730e310aa9', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:32:49.585715 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-26e309eb-bcac-4fcd-aeff-8be97e05bc1f tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.593049 Jul 26 16:32:49.587204 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 21/48] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:32:47 2022] POST /compute/v2.1/servers => generated 382 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:32:49.593355 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-319927646", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:49.676460 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.network.neutron [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] validate_networks() for [('75185dc6-2be4-492f-849d-964d05de909f', None, None, None, None, None)] {{(pid=124820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:32:50.114397 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:32:50.114928 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:32:50.115525 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:32:50.116129 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:32:50.116842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:32:50.126930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:50.127533 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:50.129220 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:50.129849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:50.154336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for project 8bb1d794693b410d8c759796d5e20281. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:32:50.160078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for user 4c6fffcc3c0d4c49848fa6c2f6b90130 and project 8bb1d794693b410d8c759796d5e20281. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:32:50.171766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:32:50.178268 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:32:50.316282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Flavor limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:32:50.317415 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Image limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:32:50.318108 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Flavor pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:32:50.318728 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Image pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:32:50.319349 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:32:50.333750 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:50.334485 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:50.335505 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:50.336743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:50.355412 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Getting quotas for project 08a954085f8f454698c55faa9351ad6e. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:32:50.360763 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Getting quotas for user 07e70b1c968443eab469777283b8fb50 and project 08a954085f8f454698c55faa9351ad6e. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:32:50.382674 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Going to run 1 instances... {{(pid=124820) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:32:50.386558 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:32:50.465180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-51827a57-8f0f-484a-8349-23033df4b1b0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.145275 Jul 26 16:32:50.467585 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 28/49] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:32:49 2022] POST /compute/v2.1/servers => generated 404 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:32:50.481561 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9ce92515-d146-4766-bb1a-5b34a6e157fe tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6c565280>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:52.536825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9ce92515-d146-4766-bb1a-5b34a6e157fe tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.074779 Jul 26 16:32:52.536825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 29/50] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:50 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:52.536825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a5c8f7bd-17d4-4f39-bf2f-df47646826ea tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:52.536825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a5c8f7bd-17d4-4f39-bf2f-df47646826ea tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:52.549025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a5c8f7bd-17d4-4f39-bf2f-df47646826ea tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:52.549025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a5c8f7bd-17d4-4f39-bf2f-df47646826ea tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1219 microversion: 2.1 time: 0.079732 Jul 26 16:32:52.549025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 30/51] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:50 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:52.549025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e41b8bbf-a7a0-461d-ab5d-c9857d08f374 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6c565b80>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:52.552048 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e41b8bbf-a7a0-461d-ab5d-c9857d08f374 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.057034 Jul 26 16:32:52.552048 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 31/52] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:50 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:52.552048 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ff2ba90b-deaa-4d9a-82d5-ad615f0d5c05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:52.552048 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ff2ba90b-deaa-4d9a-82d5-ad615f0d5c05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:52.562226 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ff2ba90b-deaa-4d9a-82d5-ad615f0d5c05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:52.562226 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ff2ba90b-deaa-4d9a-82d5-ad615f0d5c05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1245 microversion: 2.1 time: 0.080276 Jul 26 16:32:52.562226 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 32/53] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:50 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1245 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:52.587467 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2303b365-13a6-433b-9e60-bc9f1cb0794d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 2.998955 Jul 26 16:32:52.593587 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 22/54] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:32:49 2022] POST /compute/v2.1/servers => generated 385 bytes in 3006 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:32:52.601214 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-45ce5401-e97b-42dd-8658-712b54c779e9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:52.601929 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-45ce5401-e97b-42dd-8658-712b54c779e9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:52.683490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-45ce5401-e97b-42dd-8658-712b54c779e9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:52.697048 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-45ce5401-e97b-42dd-8658-712b54c779e9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1225 microversion: 2.1 time: 0.101398 Jul 26 16:32:52.698555 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 33/55] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:52 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:32:53.225950 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f8c2b556-de05-4dc8-9f55-5e1d0724e612 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6c56c160>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:53.245038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1b4630a3-046e-44de-af7b-55ada2355675 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6ce46700>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:53.371868 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f8c2b556-de05-4dc8-9f55-5e1d0724e612 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 200 len: 353 microversion: 2.1 time: 0.156496 Jul 26 16:32:53.372715 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 34/56] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:53 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:53.377689 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-da2b893c-accf-4207-bf43-8b4aad1cee1e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:53.378971 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-da2b893c-accf-4207-bf43-8b4aad1cee1e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:53.432199 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1b4630a3-046e-44de-af7b-55ada2355675 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 200 len: 287 microversion: 2.1 time: 0.215631 Jul 26 16:32:53.432199 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 23/57] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:53 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 287 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:53.437376 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0fd7aac5-18f0-4837-be49-ea47c8027145 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:53.438009 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0fd7aac5-18f0-4837-be49-ea47c8027145 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:53.478522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-da2b893c-accf-4207-bf43-8b4aad1cee1e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:53.495800 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-da2b893c-accf-4207-bf43-8b4aad1cee1e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1245 microversion: 2.1 time: 0.118479 Jul 26 16:32:53.495800 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 35/58] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:53 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:53.562023 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0fd7aac5-18f0-4837-be49-ea47c8027145 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:53.577075 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0fd7aac5-18f0-4837-be49-ea47c8027145 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1219 microversion: 2.1 time: 0.145226 Jul 26 16:32:53.577796 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 24/59] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:53 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:53.718784 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6596f6e4-3f5f-44a2-9bf4-957f927ad1f7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:53.719680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6596f6e4-3f5f-44a2-9bf4-957f927ad1f7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:53.773511 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6596f6e4-3f5f-44a2-9bf4-957f927ad1f7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:53.781462 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6596f6e4-3f5f-44a2-9bf4-957f927ad1f7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1225 microversion: 2.1 time: 0.066756 Jul 26 16:32:53.782037 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 36/60] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:53 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1225 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:54.386247 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1c453002-e68c-4138-8ceb-2790a2dcd419 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Calling method '.version_select at 0x7f4b6ce465e0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:54.423944 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-1c453002-e68c-4138-8ceb-2790a2dcd419 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] HTTP exception thrown: Volume 12e18fb7-2414-40c4-891f-0941bc73fc45 could not be found. Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1c453002-e68c-4138-8ceb-2790a2dcd419 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Request method failure captured: Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 HTTP/1.1 Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BcebvJ0XyU1WsutAob2hgjX5TGFmTPO8N6YVYVKGBmoIU0sXMEGNYHmOWL5n_gGENDhJIvoqGV4VPxFoQr2xY3kp4sGzjhKFzqi7akm92cgCL1IQKN21h6H98On4UDW8E_QD8qdGbz9tbAU8oEHQIkHFgu3AjarcmFYErLjxMb6d-Q Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 14289132bbb4432f9afaa3376835eb8e Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-VolumesGetTestJSON-1638136471 Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:32:54.432436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/14289132bbb4432f9afaa3376835eb8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/14289132bbb4432f9afaa3376835eb8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/14289132bbb4432f9afaa3376835eb8e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_14289132bbb4432f9afaa3376835eb8e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-VolumesGetTestJSON-1638136471 Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 14289132bbb4432f9afaa3376835eb8e Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-VolumesGetTestJSON-1638136471 Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-VolumesGetTestJSON-1638136471-project Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: dfa6a4b037964f22b6f9ee25acf6a094 Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-VolumesGetTestJSON-1638136471-project Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Volume 12e18fb7-2414-40c4-891f-0941bc73fc45 could not be found. Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '12e18fb7-2414-40c4-891f-0941bc73fc45'} Jul 26 16:32:54.433886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 12e18fb7-2414-40c4-891f-0941bc73fc45 could not be found. (HTTP 404) (Request-ID: req-f7cd0c7d-f7b7-4c53-a464-e5a7da3a271f) Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:54.434739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 16:32:54.435939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 12e18fb7-2414-40c4-891f-0941bc73fc45 could not be found. Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 16:32:54.437644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 12e18fb7-2414-40c4-891f-0941bc73fc45 could not be found. Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 12e18fb7-2414-40c4-891f-0941bc73fc45 could not be found. Jul 26 16:32:54.438862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.447170 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7dd7bdde-60a9-40e7-bc42-c8531d0ec037 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6c56cc10>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:54.453073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1c453002-e68c-4138-8ceb-2790a2dcd419 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] Returning 404 to user: Volume 12e18fb7-2414-40c4-891f-0941bc73fc45 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:54.455373 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1c453002-e68c-4138-8ceb-2790a2dcd419 tempest-VolumesGetTestJSON-1638136471 tempest-VolumesGetTestJSON-1638136471-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45" status: 404 len: 109 microversion: 2.1 time: 0.072190 Jul 26 16:32:54.465016 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 25/61] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:54 2022] GET /compute/v2.1/os-volumes/12e18fb7-2414-40c4-891f-0941bc73fc45 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:32:54.515358 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-53a97b46-1080-4e5f-9ac2-41b5518336ee tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:54.516181 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-53a97b46-1080-4e5f-9ac2-41b5518336ee tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:54.528861 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-53a97b46-1080-4e5f-9ac2-41b5518336ee tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:54.529358 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-53a97b46-1080-4e5f-9ac2-41b5518336ee tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:54.530118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-53a97b46-1080-4e5f-9ac2-41b5518336ee tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:54.530529 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-53a97b46-1080-4e5f-9ac2-41b5518336ee tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:54.570665 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-7dd7bdde-60a9-40e7-bc42-c8531d0ec037 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] HTTP exception thrown: Snapshot e950c2f3-357e-485a-af84-bc0bc2057f9d could not be found. Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7dd7bdde-60a9-40e7-bc42-c8531d0ec037 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Request method failure captured: Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d HTTP/1.1 Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bceip1lsYX4EsRxDQsNjMpgiUQocDfe5iqaUjRlDF3xUVrhGaf9MWL6NzX0OCwdChBFlnAF9uNduS3WtO9eC7Nz6RKyVVGZg4f6GG-GfkWJoiQooZYzql63zTcLiBdVwyoO-z7LMYH2jADvroxnGPqQ6TxG8XhVOQWzzrXhb28_CGg Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 23bea48eb25e4818bce5b81884348840 Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:32:54.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/23bea48eb25e4818bce5b81884348840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/23bea48eb25e4818bce5b81884348840"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/23bea48eb25e4818bce5b81884348840"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_23bea48eb25e4818bce5b81884348840", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 23bea48eb25e4818bce5b81884348840 Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-VolumesSnapshotsTestJSON-1379337731-project Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 10dd7a84ac7b4cde9bef32976f374386 Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379337731-project Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Snapshot e950c2f3-357e-485a-af84-bc0bc2057f9d could not be found. Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': 'e950c2f3-357e-485a-af84-bc0bc2057f9d'} Jul 26 16:32:54.575685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e950c2f3-357e-485a-af84-bc0bc2057f9d could not be found. (HTTP 404) (Request-ID: req-75031c51-429c-44c3-8fc2-922e5f430fdf) Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.576591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 16:32:54.577653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e950c2f3-357e-485a-af84-bc0bc2057f9d could not be found. Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 26 16:32:54.578953 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e950c2f3-357e-485a-af84-bc0bc2057f9d could not be found. Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e950c2f3-357e-485a-af84-bc0bc2057f9d could not be found. Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7dd7bdde-60a9-40e7-bc42-c8531d0ec037 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Returning 404 to user: Snapshot e950c2f3-357e-485a-af84-bc0bc2057f9d could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:54.580075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7dd7bdde-60a9-40e7-bc42-c8531d0ec037 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d" status: 404 len: 111 microversion: 2.1 time: 0.133201 Jul 26 16:32:54.580765 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 37/62] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:32:54 2022] GET /compute/v2.1/os-snapshots/e950c2f3-357e-485a-af84-bc0bc2057f9d => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:32:54.588347 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1639000062", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "064214c0-586f-4d9b-9abf-5c6b26d0c406"}], "security_groups": [{"name": "tempest-securitygroup--731672726"}], "key_name": "tempest-keypair-156862295", "user_data": "}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:32:54.906548 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] validate_networks() for [('064214c0-586f-4d9b-9abf-5c6b26d0c406', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:32:54.980675 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-53a97b46-1080-4e5f-9ac2-41b5518336ee tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:54.993407 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-53a97b46-1080-4e5f-9ac2-41b5518336ee tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1249 microversion: 2.1 time: 0.483515 Jul 26 16:32:55.005346 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 26/63] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:54 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1249 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:55.013059 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d1e5dadd-759f-44f8-a187-f6bb96ac22d7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6c53cca0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:55.377218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d1e5dadd-759f-44f8-a187-f6bb96ac22d7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "DELETE /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b" status: 202 len: 0 microversion: 2.1 time: 0.370448 Jul 26 16:32:55.379122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 27/64] 10.222.0.144 () {58 vars in 1253 bytes} [Tue Jul 26 16:32:55 2022] DELETE /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:32:55.385721 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f12d80e1-1afe-4d64-89ee-65e82be5589c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:55.387637 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f12d80e1-1afe-4d64-89ee-65e82be5589c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:55.408117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f12d80e1-1afe-4d64-89ee-65e82be5589c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:55.409011 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f12d80e1-1afe-4d64-89ee-65e82be5589c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:55.412665 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f12d80e1-1afe-4d64-89ee-65e82be5589c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:55.413367 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f12d80e1-1afe-4d64-89ee-65e82be5589c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:55.520571 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f12d80e1-1afe-4d64-89ee-65e82be5589c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:55.528999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f12d80e1-1afe-4d64-89ee-65e82be5589c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1271 microversion: 2.1 time: 0.148313 Jul 26 16:32:55.529937 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 28/65] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:55 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:55.534866 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5324db44-8d25-446e-8924-4ffe1c888689 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:55.535484 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5324db44-8d25-446e-8924-4ffe1c888689 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:55.541465 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5324db44-8d25-446e-8924-4ffe1c888689 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:55.541917 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5324db44-8d25-446e-8924-4ffe1c888689 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:55.542707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5324db44-8d25-446e-8924-4ffe1c888689 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:55.543129 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5324db44-8d25-446e-8924-4ffe1c888689 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:55.552837 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:32:55.553262 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:32:55.554154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:32:55.554683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:32:55.555110 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:32:55.565180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:55.566291 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:55.567275 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:55.568612 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:55.603370 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Getting quotas for project 4088561009754a839604e3798787d8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:32:55.607637 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Getting quotas for user 1b9d76409f834b478981c0bbc0c3d4b6 and project 4088561009754a839604e3798787d8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:32:55.620069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:32:55.622987 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:32:55.623533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5324db44-8d25-446e-8924-4ffe1c888689 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:55.633907 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5324db44-8d25-446e-8924-4ffe1c888689 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1221 microversion: 2.1 time: 0.102472 Jul 26 16:32:55.641917 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 29/66] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:55 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1221 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:55.647301 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-119bb064-9cd1-4953-a3f1-c9dd70f7a2c7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6c549ee0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:55.708417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-119bb064-9cd1-4953-a3f1-c9dd70f7a2c7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b" status: 200 len: 345 microversion: 2.1 time: 0.065327 Jul 26 16:32:55.709032 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 30/67] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:55 2022] GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:32:55.918554 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-332ff4a5-4ed7-4a13-a5ed-efd7dec0ca94 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.337048 Jul 26 16:32:55.919403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 38/68] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:32:54 2022] POST /compute/v2.1/servers => generated 403 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:32:55.932434 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-593533cd-fb5e-49e6-90bf-2e2ac0940448 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:55.933060 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-593533cd-fb5e-49e6-90bf-2e2ac0940448 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:56.016032 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-037fbe35-b1c6-42ed-8457-84dc43842ce8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:56.026161 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-037fbe35-b1c6-42ed-8457-84dc43842ce8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:56.032860 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-037fbe35-b1c6-42ed-8457-84dc43842ce8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:56.033325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-037fbe35-b1c6-42ed-8457-84dc43842ce8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:56.034246 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-037fbe35-b1c6-42ed-8457-84dc43842ce8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:56.035217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-037fbe35-b1c6-42ed-8457-84dc43842ce8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:56.082237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-593533cd-fb5e-49e6-90bf-2e2ac0940448 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:56.092047 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-593533cd-fb5e-49e6-90bf-2e2ac0940448 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1241 microversion: 2.1 time: 0.162777 Jul 26 16:32:56.093134 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 31/69] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:55 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1241 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:56.197475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-037fbe35-b1c6-42ed-8457-84dc43842ce8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:56.211736 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-037fbe35-b1c6-42ed-8457-84dc43842ce8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1297 microversion: 2.1 time: 0.200393 Jul 26 16:32:56.224976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 39/70] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:56 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1297 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:56.551399 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5380e109-b5c5-49ee-91ac-697ec87353de tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:56.552625 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5380e109-b5c5-49ee-91ac-697ec87353de tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:56.558914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5380e109-b5c5-49ee-91ac-697ec87353de tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:56.559373 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5380e109-b5c5-49ee-91ac-697ec87353de tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:56.560181 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5380e109-b5c5-49ee-91ac-697ec87353de tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:56.560662 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5380e109-b5c5-49ee-91ac-697ec87353de tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:56.638914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5380e109-b5c5-49ee-91ac-697ec87353de tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:56.648590 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5380e109-b5c5-49ee-91ac-697ec87353de tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1279 microversion: 2.1 time: 0.102183 Jul 26 16:32:56.649696 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 32/71] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:56 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1279 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:56.655546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e5146bad-3625-4f98-a872-ebba464e7a69 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:56.656466 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e5146bad-3625-4f98-a872-ebba464e7a69 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:56.669182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5146bad-3625-4f98-a872-ebba464e7a69 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:56.669846 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5146bad-3625-4f98-a872-ebba464e7a69 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:56.670803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5146bad-3625-4f98-a872-ebba464e7a69 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:56.671391 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5146bad-3625-4f98-a872-ebba464e7a69 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:56.724435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-321e56b7-aa02-40be-b851-64b30acd8fe7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6c5541f0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:56.759833 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e5146bad-3625-4f98-a872-ebba464e7a69 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:56.769552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e5146bad-3625-4f98-a872-ebba464e7a69 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1277 microversion: 2.1 time: 0.118176 Jul 26 16:32:56.771770 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 40/72] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:56 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1277 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:56.772303 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-321e56b7-aa02-40be-b851-64b30acd8fe7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] HTTP exception thrown: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-321e56b7-aa02-40be-b851-64b30acd8fe7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Request method failure captured: Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b HTTP/1.1 Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bceip1lsYX4EsRxDQsNjMpgiUQocDfe5iqaUjRlDF3xUVrhGaf9MWL6NzX0OCwdChBFlnAF9uNduS3WtO9eC7Nz6RKyVVGZg4f6GG-GfkWJoiQooZYzql63zTcLiBdVwyoO-z7LMYH2jADvroxnGPqQ6TxG8XhVOQWzzrXhb28_CGg Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 23bea48eb25e4818bce5b81884348840 Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:32:56.774260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/23bea48eb25e4818bce5b81884348840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/23bea48eb25e4818bce5b81884348840"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/23bea48eb25e4818bce5b81884348840"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_23bea48eb25e4818bce5b81884348840", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 23bea48eb25e4818bce5b81884348840 Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-VolumesSnapshotsTestJSON-1379337731-project Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 10dd7a84ac7b4cde9bef32976f374386 Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379337731-project Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '84f70324-874c-4f8a-852b-8f803f89d02b'} Jul 26 16:32:56.775315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. (HTTP 404) (Request-ID: req-8e4485f1-cb4e-4c2f-a25d-ec4ac44c015b) Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:56.775973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 16:32:56.776935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 16:32:56.777825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-321e56b7-aa02-40be-b851-64b30acd8fe7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Returning 404 to user: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:56.780330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-321e56b7-aa02-40be-b851-64b30acd8fe7 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b" status: 404 len: 109 microversion: 2.1 time: 0.056970 Jul 26 16:32:56.786067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 33/73] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:56 2022] GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 16:32:56.791218 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fe207c79-143b-449c-87d3-61530af5403d tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6c4f0700>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:56.825039 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-fe207c79-143b-449c-87d3-61530af5403d tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] HTTP exception thrown: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fe207c79-143b-449c-87d3-61530af5403d tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Request method failure captured: Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: DELETE /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b HTTP/1.1 Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bceip1lsYX4EsRxDQsNjMpgiUQocDfe5iqaUjRlDF3xUVrhGaf9MWL6NzX0OCwdChBFlnAF9uNduS3WtO9eC7Nz6RKyVVGZg4f6GG-GfkWJoiQooZYzql63zTcLiBdVwyoO-z7LMYH2jADvroxnGPqQ6TxG8XhVOQWzzrXhb28_CGg Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 23bea48eb25e4818bce5b81884348840 Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:32:56.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/23bea48eb25e4818bce5b81884348840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/23bea48eb25e4818bce5b81884348840"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/23bea48eb25e4818bce5b81884348840"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_23bea48eb25e4818bce5b81884348840", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 23bea48eb25e4818bce5b81884348840 Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-VolumesSnapshotsTestJSON-1379337731-project Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 10dd7a84ac7b4cde9bef32976f374386 Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379337731-project Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '84f70324-874c-4f8a-852b-8f803f89d02b'} Jul 26 16:32:56.828088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. (HTTP 404) (Request-ID: req-82b0f7cb-ac77-4cc6-84d9-c01a61a954f8) Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:56.829003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 26 16:32:56.830116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 26 16:32:56.831044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fe207c79-143b-449c-87d3-61530af5403d tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Returning 404 to user: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fe207c79-143b-449c-87d3-61530af5403d tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "DELETE /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b" status: 404 len: 109 microversion: 2.1 time: 0.041505 Jul 26 16:32:56.832066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 41/74] 10.222.0.144 () {58 vars in 1253 bytes} [Tue Jul 26 16:32:56 2022] DELETE /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:32:56.837804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-193daf44-c26b-4979-9f32-29a7e2403ff4 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Calling method '.version_select at 0x7f4b6c4a55e0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:56.880265 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-193daf44-c26b-4979-9f32-29a7e2403ff4 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] HTTP exception thrown: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-193daf44-c26b-4979-9f32-29a7e2403ff4 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Request method failure captured: Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b HTTP/1.1 Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bceip1lsYX4EsRxDQsNjMpgiUQocDfe5iqaUjRlDF3xUVrhGaf9MWL6NzX0OCwdChBFlnAF9uNduS3WtO9eC7Nz6RKyVVGZg4f6GG-GfkWJoiQooZYzql63zTcLiBdVwyoO-z7LMYH2jADvroxnGPqQ6TxG8XhVOQWzzrXhb28_CGg Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 23bea48eb25e4818bce5b81884348840 Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:32:56.882229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/23bea48eb25e4818bce5b81884348840"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/23bea48eb25e4818bce5b81884348840"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/23bea48eb25e4818bce5b81884348840"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_23bea48eb25e4818bce5b81884348840", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 23bea48eb25e4818bce5b81884348840 Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379337731 Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-VolumesSnapshotsTestJSON-1379337731-project Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 10dd7a84ac7b4cde9bef32976f374386 Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379337731-project Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '84f70324-874c-4f8a-852b-8f803f89d02b'} Jul 26 16:32:56.883284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. (HTTP 404) (Request-ID: req-f3737063-1fdd-4111-98ee-d02ba27808a7) Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:56.883949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 26 16:32:56.893783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 26 16:32:56.894943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-193daf44-c26b-4979-9f32-29a7e2403ff4 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] Returning 404 to user: Volume 84f70324-874c-4f8a-852b-8f803f89d02b could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-193daf44-c26b-4979-9f32-29a7e2403ff4 tempest-VolumesSnapshotsTestJSON-1379337731 tempest-VolumesSnapshotsTestJSON-1379337731-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b" status: 404 len: 109 microversion: 2.1 time: 0.050026 Jul 26 16:32:56.896258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 34/75] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:32:56 2022] GET /compute/v2.1/os-volumes/84f70324-874c-4f8a-852b-8f803f89d02b => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:32:57.118693 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9faacd03-3bf7-4bad-b77a-ce0459a25042 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:57.119315 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9faacd03-3bf7-4bad-b77a-ce0459a25042 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:57.232845 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b4a0c193-4a97-44dd-8411-cc55d52548a6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:57.233473 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b4a0c193-4a97-44dd-8411-cc55d52548a6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:57.244729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b4a0c193-4a97-44dd-8411-cc55d52548a6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:57.254836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b4a0c193-4a97-44dd-8411-cc55d52548a6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:57.255704 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b4a0c193-4a97-44dd-8411-cc55d52548a6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:57.256161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b4a0c193-4a97-44dd-8411-cc55d52548a6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:57.342777 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9faacd03-3bf7-4bad-b77a-ce0459a25042 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:57.350140 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9faacd03-3bf7-4bad-b77a-ce0459a25042 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1241 microversion: 2.1 time: 0.235737 Jul 26 16:32:57.351235 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 42/76] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:57 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1241 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:57.354476 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b4a0c193-4a97-44dd-8411-cc55d52548a6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:57.362325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b4a0c193-4a97-44dd-8411-cc55d52548a6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1297 microversion: 2.1 time: 0.133482 Jul 26 16:32:57.363058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 35/77] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:57 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1297 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:57.679751 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-686a056d-4a6a-4c9b-92af-3de4caf03fb7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:57.681248 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-686a056d-4a6a-4c9b-92af-3de4caf03fb7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:57.695146 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-686a056d-4a6a-4c9b-92af-3de4caf03fb7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:57.696118 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-686a056d-4a6a-4c9b-92af-3de4caf03fb7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:57.697573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-686a056d-4a6a-4c9b-92af-3de4caf03fb7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:57.698351 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-686a056d-4a6a-4c9b-92af-3de4caf03fb7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:57.799243 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-34fdae7e-0a38-44da-98db-2b78f0126ef8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:57.801349 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-34fdae7e-0a38-44da-98db-2b78f0126ef8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:57.820300 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-34fdae7e-0a38-44da-98db-2b78f0126ef8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:57.822209 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-34fdae7e-0a38-44da-98db-2b78f0126ef8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:57.823734 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-34fdae7e-0a38-44da-98db-2b78f0126ef8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:57.825267 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-34fdae7e-0a38-44da-98db-2b78f0126ef8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:57.864195 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-686a056d-4a6a-4c9b-92af-3de4caf03fb7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:57.874261 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-686a056d-4a6a-4c9b-92af-3de4caf03fb7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1279 microversion: 2.1 time: 0.206042 Jul 26 16:32:57.879567 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 43/78] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:57 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1279 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:57.938264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-34fdae7e-0a38-44da-98db-2b78f0126ef8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:57.947397 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-34fdae7e-0a38-44da-98db-2b78f0126ef8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1277 microversion: 2.1 time: 0.157278 Jul 26 16:32:57.960775 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 36/79] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:57 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:58.371577 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1f8dbee6-b57f-451f-885b-10c4b386b528 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:58.372263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1f8dbee6-b57f-451f-885b-10c4b386b528 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:58.376133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:32:58.382566 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f8dbee6-b57f-451f-885b-10c4b386b528 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:58.383106 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f8dbee6-b57f-451f-885b-10c4b386b528 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:58.384348 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f8dbee6-b57f-451f-885b-10c4b386b528 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:58.384885 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f8dbee6-b57f-451f-885b-10c4b386b528 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:58.385215 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-deee9acb-cd0b-4de2-a828-27bd4eaf2cd1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:58.386164 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-deee9acb-cd0b-4de2-a828-27bd4eaf2cd1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:58.397360 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-deee9acb-cd0b-4de2-a828-27bd4eaf2cd1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:58.403057 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-deee9acb-cd0b-4de2-a828-27bd4eaf2cd1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:58.403057 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-deee9acb-cd0b-4de2-a828-27bd4eaf2cd1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:58.405009 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-deee9acb-cd0b-4de2-a828-27bd4eaf2cd1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:58.460467 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1f8dbee6-b57f-451f-885b-10c4b386b528 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:58.470284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1f8dbee6-b57f-451f-885b-10c4b386b528 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1245 microversion: 2.1 time: 0.102541 Jul 26 16:32:58.470965 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 44/80] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:58 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1245 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:58.515339 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-deee9acb-cd0b-4de2-a828-27bd4eaf2cd1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:58.523342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-deee9acb-cd0b-4de2-a828-27bd4eaf2cd1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1297 microversion: 2.1 time: 0.143391 Jul 26 16:32:58.524062 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 37/81] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:58 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1297 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:58.897848 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b45a0d53-cd61-4b9a-af6a-42d63f7a44b9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:58.898458 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b45a0d53-cd61-4b9a-af6a-42d63f7a44b9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:58.905053 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b45a0d53-cd61-4b9a-af6a-42d63f7a44b9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:58.905505 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b45a0d53-cd61-4b9a-af6a-42d63f7a44b9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:58.906273 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b45a0d53-cd61-4b9a-af6a-42d63f7a44b9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:58.906707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b45a0d53-cd61-4b9a-af6a-42d63f7a44b9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:58.971635 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b45a0d53-cd61-4b9a-af6a-42d63f7a44b9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:58.976531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9e48421d-074a-42c5-b062-e251954c391c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:58.976531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9e48421d-074a-42c5-b062-e251954c391c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:58.983858 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e48421d-074a-42c5-b062-e251954c391c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:58.984558 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e48421d-074a-42c5-b062-e251954c391c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:58.985487 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e48421d-074a-42c5-b062-e251954c391c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:58.986605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e48421d-074a-42c5-b062-e251954c391c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:58.986760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b45a0d53-cd61-4b9a-af6a-42d63f7a44b9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1279 microversion: 2.1 time: 0.093058 Jul 26 16:32:58.997956 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 45/82] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:58 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1279 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:59.091688 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9e48421d-074a-42c5-b062-e251954c391c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:59.101668 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9e48421d-074a-42c5-b062-e251954c391c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1277 microversion: 2.1 time: 0.137554 Jul 26 16:32:59.115432 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 38/83] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:58 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:32:59.492252 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7cc96266-4f81-422c-982c-349591c2a23a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:59.492899 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7cc96266-4f81-422c-982c-349591c2a23a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:59.499443 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cc96266-4f81-422c-982c-349591c2a23a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:59.500115 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cc96266-4f81-422c-982c-349591c2a23a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:59.501092 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cc96266-4f81-422c-982c-349591c2a23a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:59.501518 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cc96266-4f81-422c-982c-349591c2a23a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:59.545092 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8f7f7772-6838-4300-92c8-cc4fb53f7f62 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:32:59.547032 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8f7f7772-6838-4300-92c8-cc4fb53f7f62 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:32:59.553224 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8f7f7772-6838-4300-92c8-cc4fb53f7f62 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:59.553781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8f7f7772-6838-4300-92c8-cc4fb53f7f62 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:59.554700 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8f7f7772-6838-4300-92c8-cc4fb53f7f62 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:32:59.555196 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8f7f7772-6838-4300-92c8-cc4fb53f7f62 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:32:59.569070 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7cc96266-4f81-422c-982c-349591c2a23a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:59.576639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7cc96266-4f81-422c-982c-349591c2a23a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1245 microversion: 2.1 time: 0.088177 Jul 26 16:32:59.577208 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 46/84] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:59 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:32:59.622945 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8f7f7772-6838-4300-92c8-cc4fb53f7f62 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:32:59.631352 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8f7f7772-6838-4300-92c8-cc4fb53f7f62 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1297 microversion: 2.1 time: 0.090026 Jul 26 16:32:59.643338 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 39/85] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:32:59 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:00.007922 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e26f7db9-16ea-4ea3-903c-a96d3ad7c694 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:00.008413 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e26f7db9-16ea-4ea3-903c-a96d3ad7c694 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:00.014938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e26f7db9-16ea-4ea3-903c-a96d3ad7c694 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:00.015396 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e26f7db9-16ea-4ea3-903c-a96d3ad7c694 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:00.016616 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e26f7db9-16ea-4ea3-903c-a96d3ad7c694 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:00.017060 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e26f7db9-16ea-4ea3-903c-a96d3ad7c694 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:00.086240 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e26f7db9-16ea-4ea3-903c-a96d3ad7c694 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:00.094783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e26f7db9-16ea-4ea3-903c-a96d3ad7c694 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1279 microversion: 2.1 time: 0.090758 Jul 26 16:33:00.095452 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 47/86] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:00 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:00.122420 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2bc0236e-6c08-415b-b6df-e324d128a390 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:00.124782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2bc0236e-6c08-415b-b6df-e324d128a390 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:00.129595 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2bc0236e-6c08-415b-b6df-e324d128a390 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:00.130046 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2bc0236e-6c08-415b-b6df-e324d128a390 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:00.130835 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2bc0236e-6c08-415b-b6df-e324d128a390 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:00.131266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2bc0236e-6c08-415b-b6df-e324d128a390 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:00.196902 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2bc0236e-6c08-415b-b6df-e324d128a390 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:00.206145 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2bc0236e-6c08-415b-b6df-e324d128a390 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1277 microversion: 2.1 time: 0.086642 Jul 26 16:33:00.207175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 40/87] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:00 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:00.601036 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-53e50ac3-78c5-43d6-80dd-16b527582366 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:00.601036 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-53e50ac3-78c5-43d6-80dd-16b527582366 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:00.613200 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-53e50ac3-78c5-43d6-80dd-16b527582366 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:00.614260 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-53e50ac3-78c5-43d6-80dd-16b527582366 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:00.615368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-53e50ac3-78c5-43d6-80dd-16b527582366 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:00.615978 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-53e50ac3-78c5-43d6-80dd-16b527582366 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:00.653421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-adf7ea59-a1d2-480e-b0ed-251a69266e00 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:00.654289 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-adf7ea59-a1d2-480e-b0ed-251a69266e00 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:00.656695 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=4 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:00.665644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-adf7ea59-a1d2-480e-b0ed-251a69266e00 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:00.668356 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-adf7ea59-a1d2-480e-b0ed-251a69266e00 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:00.669383 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-adf7ea59-a1d2-480e-b0ed-251a69266e00 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:00.673717 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-adf7ea59-a1d2-480e-b0ed-251a69266e00 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:00.749011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-53e50ac3-78c5-43d6-80dd-16b527582366 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:00.762389 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-53e50ac3-78c5-43d6-80dd-16b527582366 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1245 microversion: 2.1 time: 0.167873 Jul 26 16:33:00.762992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 48/88] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:00 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1245 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:00.804734 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-adf7ea59-a1d2-480e-b0ed-251a69266e00 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:00.932509 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-adf7ea59-a1d2-480e-b0ed-251a69266e00 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1297 microversion: 2.1 time: 0.282257 Jul 26 16:33:00.933441 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 41/89] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:00 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1297 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:01.122349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d6997ce2-4ef3-4010-ba66-9826a4453221 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:01.122349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d6997ce2-4ef3-4010-ba66-9826a4453221 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:01.130060 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d6997ce2-4ef3-4010-ba66-9826a4453221 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:01.131632 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d6997ce2-4ef3-4010-ba66-9826a4453221 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:01.133934 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d6997ce2-4ef3-4010-ba66-9826a4453221 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:01.134745 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d6997ce2-4ef3-4010-ba66-9826a4453221 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:01.229497 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d52f13c7-8984-4815-a55f-2ff8d6dabde8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:01.230259 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d52f13c7-8984-4815-a55f-2ff8d6dabde8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:01.248090 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d52f13c7-8984-4815-a55f-2ff8d6dabde8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:01.250785 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d52f13c7-8984-4815-a55f-2ff8d6dabde8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:01.251869 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d52f13c7-8984-4815-a55f-2ff8d6dabde8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:01.252487 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d52f13c7-8984-4815-a55f-2ff8d6dabde8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:01.293455 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d6997ce2-4ef3-4010-ba66-9826a4453221 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:01.306256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d6997ce2-4ef3-4010-ba66-9826a4453221 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1289 microversion: 2.1 time: 0.190779 Jul 26 16:33:01.308854 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 49/90] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:01 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1289 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:01.532010 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d52f13c7-8984-4815-a55f-2ff8d6dabde8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:01.544224 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d52f13c7-8984-4815-a55f-2ff8d6dabde8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1277 microversion: 2.1 time: 0.318485 Jul 26 16:33:01.549417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 42/91] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:01 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1277 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:01.783230 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5422486a-7c21-4dde-9458-1863ed38fe61 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:01.784187 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5422486a-7c21-4dde-9458-1863ed38fe61 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:01.797831 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5422486a-7c21-4dde-9458-1863ed38fe61 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:01.798617 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5422486a-7c21-4dde-9458-1863ed38fe61 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:01.799951 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5422486a-7c21-4dde-9458-1863ed38fe61 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:01.800624 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5422486a-7c21-4dde-9458-1863ed38fe61 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:01.928984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5422486a-7c21-4dde-9458-1863ed38fe61 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:01.951855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5422486a-7c21-4dde-9458-1863ed38fe61 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.172313 Jul 26 16:33:01.953237 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 50/92] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:01 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:01.955120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-aaadb19b-4f6b-439a-a3ca-829f82436d07 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:01.957823 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-aaadb19b-4f6b-439a-a3ca-829f82436d07 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:01.966184 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aaadb19b-4f6b-439a-a3ca-829f82436d07 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:01.966838 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aaadb19b-4f6b-439a-a3ca-829f82436d07 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:01.967900 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aaadb19b-4f6b-439a-a3ca-829f82436d07 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:01.968585 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aaadb19b-4f6b-439a-a3ca-829f82436d07 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:02.205210 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-aaadb19b-4f6b-439a-a3ca-829f82436d07 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:02.215007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-aaadb19b-4f6b-439a-a3ca-829f82436d07 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1315 microversion: 2.1 time: 0.264698 Jul 26 16:33:02.225801 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 43/93] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:01 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:02.336015 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-63c6d62e-66ca-4e2c-b41b-127eb2818e98 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:02.336894 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-63c6d62e-66ca-4e2c-b41b-127eb2818e98 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:02.343731 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-63c6d62e-66ca-4e2c-b41b-127eb2818e98 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:02.344367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-63c6d62e-66ca-4e2c-b41b-127eb2818e98 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:02.345395 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-63c6d62e-66ca-4e2c-b41b-127eb2818e98 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:02.345799 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-63c6d62e-66ca-4e2c-b41b-127eb2818e98 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:02.574322 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4106dee6-b7e4-45c6-af62-c942270955fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:02.577041 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4106dee6-b7e4-45c6-af62-c942270955fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:02.589147 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4106dee6-b7e4-45c6-af62-c942270955fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:02.590289 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4106dee6-b7e4-45c6-af62-c942270955fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:02.591354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4106dee6-b7e4-45c6-af62-c942270955fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:02.591796 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4106dee6-b7e4-45c6-af62-c942270955fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:02.606200 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-63c6d62e-66ca-4e2c-b41b-127eb2818e98 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:02.614444 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-63c6d62e-66ca-4e2c-b41b-127eb2818e98 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.283691 Jul 26 16:33:02.618121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 51/94] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:02 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:02.726447 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4106dee6-b7e4-45c6-af62-c942270955fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:02.734433 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4106dee6-b7e4-45c6-af62-c942270955fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1285 microversion: 2.1 time: 0.168202 Jul 26 16:33:02.736174 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 44/95] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:02 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:02.977732 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-79fdb416-713b-4b5d-b3ab-92fec6982081 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:02.978585 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-79fdb416-713b-4b5d-b3ab-92fec6982081 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:02.994866 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79fdb416-713b-4b5d-b3ab-92fec6982081 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:02.995328 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79fdb416-713b-4b5d-b3ab-92fec6982081 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:02.996124 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79fdb416-713b-4b5d-b3ab-92fec6982081 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:02.996683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79fdb416-713b-4b5d-b3ab-92fec6982081 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:03.239322 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ac580d7f-3fd5-429a-b38f-950df23b0d41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:03.242487 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ac580d7f-3fd5-429a-b38f-950df23b0d41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:03.256731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ac580d7f-3fd5-429a-b38f-950df23b0d41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:03.261750 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ac580d7f-3fd5-429a-b38f-950df23b0d41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:03.263811 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ac580d7f-3fd5-429a-b38f-950df23b0d41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:03.287948 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ac580d7f-3fd5-429a-b38f-950df23b0d41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:03.440708 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-79fdb416-713b-4b5d-b3ab-92fec6982081 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:03.455625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-79fdb416-713b-4b5d-b3ab-92fec6982081 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.482118 Jul 26 16:33:03.457100 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 52/96] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:02 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:03.583298 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ac580d7f-3fd5-429a-b38f-950df23b0d41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:03.592560 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ac580d7f-3fd5-429a-b38f-950df23b0d41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.358137 Jul 26 16:33:03.593898 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 45/97] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:03 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:03.640253 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-134f7d03-8e40-4b5a-a70e-6ce1cfae83a4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:03.641324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-134f7d03-8e40-4b5a-a70e-6ce1cfae83a4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:03.647708 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-134f7d03-8e40-4b5a-a70e-6ce1cfae83a4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:03.648165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-134f7d03-8e40-4b5a-a70e-6ce1cfae83a4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:03.648970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-134f7d03-8e40-4b5a-a70e-6ce1cfae83a4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:03.649410 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-134f7d03-8e40-4b5a-a70e-6ce1cfae83a4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:03.755748 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-da56ce9a-b853-49e9-8417-447dc99299db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:03.756365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-da56ce9a-b853-49e9-8417-447dc99299db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:03.762403 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-da56ce9a-b853-49e9-8417-447dc99299db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:03.762858 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-da56ce9a-b853-49e9-8417-447dc99299db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:03.763628 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-da56ce9a-b853-49e9-8417-447dc99299db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:03.764066 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-da56ce9a-b853-49e9-8417-447dc99299db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:03.829201 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-da56ce9a-b853-49e9-8417-447dc99299db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:03.832651 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:03.836934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-da56ce9a-b853-49e9-8417-447dc99299db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1295 microversion: 2.1 time: 0.085072 Jul 26 16:33:03.837496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 46/98] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:03 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:03.886999 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-134f7d03-8e40-4b5a-a70e-6ce1cfae83a4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:03.895199 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-134f7d03-8e40-4b5a-a70e-6ce1cfae83a4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.259217 Jul 26 16:33:03.895776 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 53/99] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:03 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:04.478818 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3b24c32e-1204-4ead-b968-54ace37a9567 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:04.479357 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3b24c32e-1204-4ead-b968-54ace37a9567 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:04.486011 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3b24c32e-1204-4ead-b968-54ace37a9567 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:04.486484 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3b24c32e-1204-4ead-b968-54ace37a9567 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:04.487287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3b24c32e-1204-4ead-b968-54ace37a9567 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:04.487750 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3b24c32e-1204-4ead-b968-54ace37a9567 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:04.553242 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3b24c32e-1204-4ead-b968-54ace37a9567 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:04.560522 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3b24c32e-1204-4ead-b968-54ace37a9567 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.086576 Jul 26 16:33:04.561068 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 47/100] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:04 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:04.613572 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b8e63d59-f8d1-4eb9-a9cf-bbb70cfb7314 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:04.614177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b8e63d59-f8d1-4eb9-a9cf-bbb70cfb7314 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:04.620198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b8e63d59-f8d1-4eb9-a9cf-bbb70cfb7314 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:04.620681 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b8e63d59-f8d1-4eb9-a9cf-bbb70cfb7314 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:04.621423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b8e63d59-f8d1-4eb9-a9cf-bbb70cfb7314 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:04.621851 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b8e63d59-f8d1-4eb9-a9cf-bbb70cfb7314 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:04.748162 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b8e63d59-f8d1-4eb9-a9cf-bbb70cfb7314 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:04.756498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b8e63d59-f8d1-4eb9-a9cf-bbb70cfb7314 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.146631 Jul 26 16:33:04.760723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 54/101] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:04 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:04.857652 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b9dd4264-902a-48d0-af62-c68b82c15088 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:04.858263 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b9dd4264-902a-48d0-af62-c68b82c15088 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:04.864730 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b9dd4264-902a-48d0-af62-c68b82c15088 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:04.865217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b9dd4264-902a-48d0-af62-c68b82c15088 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:04.865970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b9dd4264-902a-48d0-af62-c68b82c15088 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:04.866402 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b9dd4264-902a-48d0-af62-c68b82c15088 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:04.917508 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b15a58a0-6c43-465a-acad-8c65f3e839a6 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:04.918184 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b15a58a0-6c43-465a-acad-8c65f3e839a6 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:04.931349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b15a58a0-6c43-465a-acad-8c65f3e839a6 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:04.931872 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b15a58a0-6c43-465a-acad-8c65f3e839a6 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:04.932640 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b15a58a0-6c43-465a-acad-8c65f3e839a6 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:04.933071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b15a58a0-6c43-465a-acad-8c65f3e839a6 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:05.055567 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b9dd4264-902a-48d0-af62-c68b82c15088 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:05.064003 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b9dd4264-902a-48d0-af62-c68b82c15088 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.209957 Jul 26 16:33:05.065188 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 48/102] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:04 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:05.112837 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b15a58a0-6c43-465a-acad-8c65f3e839a6 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:05.122303 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b15a58a0-6c43-465a-acad-8c65f3e839a6 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.209176 Jul 26 16:33:05.123205 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 55/103] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:04 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:05.582257 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-239db744-433a-48c2-986a-1d155a4518ee tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:05.583135 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-239db744-433a-48c2-986a-1d155a4518ee tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:05.589358 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-239db744-433a-48c2-986a-1d155a4518ee tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:05.589813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-239db744-433a-48c2-986a-1d155a4518ee tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:05.590585 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-239db744-433a-48c2-986a-1d155a4518ee tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:05.591019 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-239db744-433a-48c2-986a-1d155a4518ee tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:05.667420 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-239db744-433a-48c2-986a-1d155a4518ee tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:05.675734 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-239db744-433a-48c2-986a-1d155a4518ee tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.097824 Jul 26 16:33:05.676310 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 49/104] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:05 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:05.781927 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-644c309c-77cf-425f-9959-3ebc26771b83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:05.783197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-644c309c-77cf-425f-9959-3ebc26771b83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:05.793626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=6 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:05.808349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-644c309c-77cf-425f-9959-3ebc26771b83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:05.813026 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-644c309c-77cf-425f-9959-3ebc26771b83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:05.813026 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-644c309c-77cf-425f-9959-3ebc26771b83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:05.813026 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-644c309c-77cf-425f-9959-3ebc26771b83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:05.834499 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:06.059985 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-644c309c-77cf-425f-9959-3ebc26771b83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:06.068137 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-644c309c-77cf-425f-9959-3ebc26771b83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.291558 Jul 26 16:33:06.069855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 56/105] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:05 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:06.087035 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-15fa116f-dd39-4221-bf32-3399608efa75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:06.088202 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-15fa116f-dd39-4221-bf32-3399608efa75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:06.095350 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=20 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:06.097667 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-15fa116f-dd39-4221-bf32-3399608efa75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:06.098428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-15fa116f-dd39-4221-bf32-3399608efa75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:06.099705 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-15fa116f-dd39-4221-bf32-3399608efa75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:06.100414 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-15fa116f-dd39-4221-bf32-3399608efa75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:06.147114 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9eba5828-51ba-4807-b560-43f0494f5a0a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:06.148806 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9eba5828-51ba-4807-b560-43f0494f5a0a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:06.162873 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9eba5828-51ba-4807-b560-43f0494f5a0a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:06.166912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9eba5828-51ba-4807-b560-43f0494f5a0a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:06.167859 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9eba5828-51ba-4807-b560-43f0494f5a0a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:06.168417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9eba5828-51ba-4807-b560-43f0494f5a0a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:06.253909 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-15fa116f-dd39-4221-bf32-3399608efa75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:06.261280 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-15fa116f-dd39-4221-bf32-3399608efa75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.178950 Jul 26 16:33:06.261839 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 50/106] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:06 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:06.613020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9eba5828-51ba-4807-b560-43f0494f5a0a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:06.623465 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9eba5828-51ba-4807-b560-43f0494f5a0a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.483042 Jul 26 16:33:06.625360 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 57/107] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:06 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:06.696819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2a6ff4fc-fd7d-4276-9176-481d8d5d79bb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:06.697471 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2a6ff4fc-fd7d-4276-9176-481d8d5d79bb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:06.704145 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2a6ff4fc-fd7d-4276-9176-481d8d5d79bb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:06.704633 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2a6ff4fc-fd7d-4276-9176-481d8d5d79bb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:06.705593 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2a6ff4fc-fd7d-4276-9176-481d8d5d79bb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:06.706213 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2a6ff4fc-fd7d-4276-9176-481d8d5d79bb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:06.825881 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2a6ff4fc-fd7d-4276-9176-481d8d5d79bb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:06.838330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2a6ff4fc-fd7d-4276-9176-481d8d5d79bb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.143065 Jul 26 16:33:06.838330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 51/108] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:06 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:07.092483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b51978b8-695a-4554-8071-1c255647e834 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:07.093182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b51978b8-695a-4554-8071-1c255647e834 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:07.105980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b51978b8-695a-4554-8071-1c255647e834 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:07.105980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b51978b8-695a-4554-8071-1c255647e834 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:07.105980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b51978b8-695a-4554-8071-1c255647e834 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:07.105980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b51978b8-695a-4554-8071-1c255647e834 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:07.282740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-11452bf5-83be-4bb7-9447-39d11a2ba6b2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:07.283363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-11452bf5-83be-4bb7-9447-39d11a2ba6b2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:07.292147 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11452bf5-83be-4bb7-9447-39d11a2ba6b2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:07.293021 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11452bf5-83be-4bb7-9447-39d11a2ba6b2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:07.295260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11452bf5-83be-4bb7-9447-39d11a2ba6b2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:07.297573 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11452bf5-83be-4bb7-9447-39d11a2ba6b2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:07.346708 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=36 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:07.384617 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b51978b8-695a-4554-8071-1c255647e834 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:07.394741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b51978b8-695a-4554-8071-1c255647e834 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.305961 Jul 26 16:33:07.395987 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 58/109] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:07 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:07.648459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fd111172-419f-4c2f-a616-714879a6b88c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:07.652182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fd111172-419f-4c2f-a616-714879a6b88c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:07.655724 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fd111172-419f-4c2f-a616-714879a6b88c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:07.656249 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fd111172-419f-4c2f-a616-714879a6b88c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:07.657339 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fd111172-419f-4c2f-a616-714879a6b88c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:07.657847 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fd111172-419f-4c2f-a616-714879a6b88c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:07.904877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fd111172-419f-4c2f-a616-714879a6b88c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:07.917576 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fd111172-419f-4c2f-a616-714879a6b88c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.272959 Jul 26 16:33:07.918362 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 59/110] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:07 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:07.923005 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-01c90bab-2767-471a-831f-a1885e25eacc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:07.924630 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-01c90bab-2767-471a-831f-a1885e25eacc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:07.938514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-01c90bab-2767-471a-831f-a1885e25eacc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:07.939182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-01c90bab-2767-471a-831f-a1885e25eacc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:07.940133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-01c90bab-2767-471a-831f-a1885e25eacc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:07.941318 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-01c90bab-2767-471a-831f-a1885e25eacc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:07.953547 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-11452bf5-83be-4bb7-9447-39d11a2ba6b2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:07.961531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-11452bf5-83be-4bb7-9447-39d11a2ba6b2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.682742 Jul 26 16:33:07.964834 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 52/111] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:07 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:08.056053 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-01c90bab-2767-471a-831f-a1885e25eacc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:08.076824 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-01c90bab-2767-471a-831f-a1885e25eacc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.151749 Jul 26 16:33:08.078196 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 60/112] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:07 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:08.420294 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0d5c436c-24b2-4b9d-b633-4a0545aba683 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:08.421213 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0d5c436c-24b2-4b9d-b633-4a0545aba683 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:08.430471 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0d5c436c-24b2-4b9d-b633-4a0545aba683 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:08.431472 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0d5c436c-24b2-4b9d-b633-4a0545aba683 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:08.432553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0d5c436c-24b2-4b9d-b633-4a0545aba683 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:08.440863 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0d5c436c-24b2-4b9d-b633-4a0545aba683 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:08.619490 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0d5c436c-24b2-4b9d-b633-4a0545aba683 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:08.627247 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0d5c436c-24b2-4b9d-b633-4a0545aba683 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.214976 Jul 26 16:33:08.627831 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 53/113] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:08 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:08.950866 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ca879e48-5d3a-4d7f-9ed8-965fbf3daa21 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:08.954439 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ca879e48-5d3a-4d7f-9ed8-965fbf3daa21 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:08.968486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca879e48-5d3a-4d7f-9ed8-965fbf3daa21 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:08.970856 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca879e48-5d3a-4d7f-9ed8-965fbf3daa21 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:08.971899 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca879e48-5d3a-4d7f-9ed8-965fbf3daa21 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:08.972336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca879e48-5d3a-4d7f-9ed8-965fbf3daa21 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:08.987608 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e32b54e5-69d5-4c07-9dff-6853692c24fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:08.988221 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e32b54e5-69d5-4c07-9dff-6853692c24fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:08.991225 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:08.998953 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e32b54e5-69d5-4c07-9dff-6853692c24fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:09.001406 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e32b54e5-69d5-4c07-9dff-6853692c24fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:09.002722 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e32b54e5-69d5-4c07-9dff-6853692c24fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:09.013094 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e32b54e5-69d5-4c07-9dff-6853692c24fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:09.220537 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ca879e48-5d3a-4d7f-9ed8-965fbf3daa21 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:09.230182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ca879e48-5d3a-4d7f-9ed8-965fbf3daa21 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.292372 Jul 26 16:33:09.243963 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 61/114] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:08 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:09.249185 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-59442d0c-6e21-492f-9a4c-82b5601e6fd9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:09.250221 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-59442d0c-6e21-492f-9a4c-82b5601e6fd9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:09.263106 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59442d0c-6e21-492f-9a4c-82b5601e6fd9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:09.264885 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59442d0c-6e21-492f-9a4c-82b5601e6fd9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:09.265407 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59442d0c-6e21-492f-9a4c-82b5601e6fd9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:09.266065 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59442d0c-6e21-492f-9a4c-82b5601e6fd9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:09.408645 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-59442d0c-6e21-492f-9a4c-82b5601e6fd9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:09.425367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-59442d0c-6e21-492f-9a4c-82b5601e6fd9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.179198 Jul 26 16:33:09.426176 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 62/115] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:09 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:09.452321 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e32b54e5-69d5-4c07-9dff-6853692c24fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:09.473958 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e32b54e5-69d5-4c07-9dff-6853692c24fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.488008 Jul 26 16:33:09.476531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 54/116] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:08 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:09.649294 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9fc5c529-d585-4a36-94d8-ecc6c0423c87 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:09.649892 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9fc5c529-d585-4a36-94d8-ecc6c0423c87 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:09.656174 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9fc5c529-d585-4a36-94d8-ecc6c0423c87 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:09.656681 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9fc5c529-d585-4a36-94d8-ecc6c0423c87 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:09.657433 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9fc5c529-d585-4a36-94d8-ecc6c0423c87 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:09.657859 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9fc5c529-d585-4a36-94d8-ecc6c0423c87 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:09.867205 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9fc5c529-d585-4a36-94d8-ecc6c0423c87 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:09.874602 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9fc5c529-d585-4a36-94d8-ecc6c0423c87 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.229148 Jul 26 16:33:09.875169 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 63/117] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:09 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:10.251581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-39aebac1-37c4-46ca-b216-301070055864 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:10.252551 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-39aebac1-37c4-46ca-b216-301070055864 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:10.259502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-39aebac1-37c4-46ca-b216-301070055864 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:10.260124 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-39aebac1-37c4-46ca-b216-301070055864 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:10.272503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-39aebac1-37c4-46ca-b216-301070055864 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:10.273143 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-39aebac1-37c4-46ca-b216-301070055864 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:10.447787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d09641a2-ba16-4575-a580-145c46974f73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:10.448373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d09641a2-ba16-4575-a580-145c46974f73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:10.458144 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d09641a2-ba16-4575-a580-145c46974f73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:10.458673 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d09641a2-ba16-4575-a580-145c46974f73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:10.461536 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d09641a2-ba16-4575-a580-145c46974f73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:10.462780 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d09641a2-ba16-4575-a580-145c46974f73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:10.465632 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-39aebac1-37c4-46ca-b216-301070055864 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:10.482723 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-39aebac1-37c4-46ca-b216-301070055864 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.235007 Jul 26 16:33:10.483867 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 55/118] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:10 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:10.503836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0caae123-2151-41b4-9491-db59cafd4a18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:10.504035 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0caae123-2151-41b4-9491-db59cafd4a18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:10.510050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0caae123-2151-41b4-9491-db59cafd4a18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:10.510616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0caae123-2151-41b4-9491-db59cafd4a18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:10.511379 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0caae123-2151-41b4-9491-db59cafd4a18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:10.511806 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0caae123-2151-41b4-9491-db59cafd4a18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:10.580299 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d09641a2-ba16-4575-a580-145c46974f73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:10.589308 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d09641a2-ba16-4575-a580-145c46974f73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.145877 Jul 26 16:33:10.592750 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 64/119] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:10 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:10.671222 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0caae123-2151-41b4-9491-db59cafd4a18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:10.679477 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0caae123-2151-41b4-9491-db59cafd4a18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.180027 Jul 26 16:33:10.680050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 56/120] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:10 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:10.899601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-45505a3f-37a7-49c4-b0c1-edb8f03f1619 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:10.899601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-45505a3f-37a7-49c4-b0c1-edb8f03f1619 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:10.904226 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-45505a3f-37a7-49c4-b0c1-edb8f03f1619 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:10.904947 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-45505a3f-37a7-49c4-b0c1-edb8f03f1619 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:10.906054 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-45505a3f-37a7-49c4-b0c1-edb8f03f1619 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:10.906741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-45505a3f-37a7-49c4-b0c1-edb8f03f1619 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:11.048578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-45505a3f-37a7-49c4-b0c1-edb8f03f1619 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:11.056822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-45505a3f-37a7-49c4-b0c1-edb8f03f1619 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.164695 Jul 26 16:33:11.057390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 65/121] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:10 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:11.507806 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b17445da-05d3-4258-8161-95216770c06e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:11.511454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b17445da-05d3-4258-8161-95216770c06e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:11.517527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b17445da-05d3-4258-8161-95216770c06e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:11.518315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b17445da-05d3-4258-8161-95216770c06e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:11.519290 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b17445da-05d3-4258-8161-95216770c06e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:11.519876 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b17445da-05d3-4258-8161-95216770c06e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:11.616348 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9a4e3db5-91fd-4783-8d20-e9f1903afd73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:11.616348 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9a4e3db5-91fd-4783-8d20-e9f1903afd73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:11.619400 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9a4e3db5-91fd-4783-8d20-e9f1903afd73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:11.620039 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9a4e3db5-91fd-4783-8d20-e9f1903afd73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:11.621450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9a4e3db5-91fd-4783-8d20-e9f1903afd73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:11.623214 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9a4e3db5-91fd-4783-8d20-e9f1903afd73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:11.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9a4e3db5-91fd-4783-8d20-e9f1903afd73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:11.689658 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b17445da-05d3-4258-8161-95216770c06e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:11.697548 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9a4e3db5-91fd-4783-8d20-e9f1903afd73 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.090575 Jul 26 16:33:11.697944 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b17445da-05d3-4258-8161-95216770c06e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.194604 Jul 26 16:33:11.698138 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 66/122] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:11 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:11.698581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 57/123] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:11 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:11.702518 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ca83cf5b-41fe-4a63-9b18-09e86ae00027 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:11.703117 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ca83cf5b-41fe-4a63-9b18-09e86ae00027 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:11.708935 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca83cf5b-41fe-4a63-9b18-09e86ae00027 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:11.709383 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca83cf5b-41fe-4a63-9b18-09e86ae00027 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:11.710145 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca83cf5b-41fe-4a63-9b18-09e86ae00027 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:11.710696 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca83cf5b-41fe-4a63-9b18-09e86ae00027 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:11.839431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ca83cf5b-41fe-4a63-9b18-09e86ae00027 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:11.846752 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ca83cf5b-41fe-4a63-9b18-09e86ae00027 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.147646 Jul 26 16:33:11.847323 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 67/124] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:11 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:12.077084 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2f8f7419-baef-459d-b1ff-94ec2fefd94c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:12.077694 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2f8f7419-baef-459d-b1ff-94ec2fefd94c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:12.083420 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2f8f7419-baef-459d-b1ff-94ec2fefd94c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:12.083863 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2f8f7419-baef-459d-b1ff-94ec2fefd94c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:12.084649 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2f8f7419-baef-459d-b1ff-94ec2fefd94c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:12.085080 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2f8f7419-baef-459d-b1ff-94ec2fefd94c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:12.221082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2f8f7419-baef-459d-b1ff-94ec2fefd94c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:12.229401 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2f8f7419-baef-459d-b1ff-94ec2fefd94c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.155818 Jul 26 16:33:12.229999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 58/125] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:12 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:12.724720 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-32e38b34-87e1-4e87-b1b6-b57821973bd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:12.725259 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b07a26de-0691-47f9-a0fb-5bf4037bc8d2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:12.725772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b07a26de-0691-47f9-a0fb-5bf4037bc8d2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:12.728719 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-32e38b34-87e1-4e87-b1b6-b57821973bd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:12.739339 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b07a26de-0691-47f9-a0fb-5bf4037bc8d2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:12.740516 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b07a26de-0691-47f9-a0fb-5bf4037bc8d2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:12.742029 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b07a26de-0691-47f9-a0fb-5bf4037bc8d2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:12.742942 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b07a26de-0691-47f9-a0fb-5bf4037bc8d2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:12.748974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32e38b34-87e1-4e87-b1b6-b57821973bd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:12.750092 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32e38b34-87e1-4e87-b1b6-b57821973bd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:12.751350 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32e38b34-87e1-4e87-b1b6-b57821973bd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:12.752033 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32e38b34-87e1-4e87-b1b6-b57821973bd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:12.877272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-32e38b34-87e1-4e87-b1b6-b57821973bd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:12.920228 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-32e38b34-87e1-4e87-b1b6-b57821973bd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.182746 Jul 26 16:33:12.920228 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 68/126] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:12 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:12.921651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-111455d9-ed12-4dde-b60a-9e2dc255f8e6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:12.922354 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-111455d9-ed12-4dde-b60a-9e2dc255f8e6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:12.935838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-111455d9-ed12-4dde-b60a-9e2dc255f8e6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:12.936289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-111455d9-ed12-4dde-b60a-9e2dc255f8e6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:12.937334 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-111455d9-ed12-4dde-b60a-9e2dc255f8e6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:12.938578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-111455d9-ed12-4dde-b60a-9e2dc255f8e6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:12.984482 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b07a26de-0691-47f9-a0fb-5bf4037bc8d2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:12.994287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b07a26de-0691-47f9-a0fb-5bf4037bc8d2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.277929 Jul 26 16:33:13.008665 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 59/127] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:12 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:13.173508 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-111455d9-ed12-4dde-b60a-9e2dc255f8e6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:13.177205 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-111455d9-ed12-4dde-b60a-9e2dc255f8e6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.271247 Jul 26 16:33:13.177894 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 69/128] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:12 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:13.251511 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-025e53c2-c6fd-44bd-9ba9-d221aa0dfa4d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:13.252109 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-025e53c2-c6fd-44bd-9ba9-d221aa0dfa4d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:13.258233 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-025e53c2-c6fd-44bd-9ba9-d221aa0dfa4d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:13.258680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-025e53c2-c6fd-44bd-9ba9-d221aa0dfa4d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:13.259425 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-025e53c2-c6fd-44bd-9ba9-d221aa0dfa4d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:13.259855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-025e53c2-c6fd-44bd-9ba9-d221aa0dfa4d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:13.433726 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-025e53c2-c6fd-44bd-9ba9-d221aa0dfa4d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:13.444621 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-025e53c2-c6fd-44bd-9ba9-d221aa0dfa4d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.197189 Jul 26 16:33:13.446387 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 60/129] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:13 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:13.927151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-37390d0d-962c-4ae7-a5d9-112608666808 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:13.930650 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-37390d0d-962c-4ae7-a5d9-112608666808 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:13.938122 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-37390d0d-962c-4ae7-a5d9-112608666808 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:13.942417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-37390d0d-962c-4ae7-a5d9-112608666808 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:13.942417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-37390d0d-962c-4ae7-a5d9-112608666808 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:13.942417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-37390d0d-962c-4ae7-a5d9-112608666808 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:14.003396 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-37390d0d-962c-4ae7-a5d9-112608666808 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:14.010805 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-37390d0d-962c-4ae7-a5d9-112608666808 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.087622 Jul 26 16:33:14.011362 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 70/130] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:13 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:14.017981 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d7b6d84b-f757-486c-9f47-2825680ec460 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:14.019179 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d7b6d84b-f757-486c-9f47-2825680ec460 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:14.025795 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d7b6d84b-f757-486c-9f47-2825680ec460 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:14.026246 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d7b6d84b-f757-486c-9f47-2825680ec460 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:14.027120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d7b6d84b-f757-486c-9f47-2825680ec460 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:14.027546 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d7b6d84b-f757-486c-9f47-2825680ec460 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:14.156218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d7b6d84b-f757-486c-9f47-2825680ec460 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:14.163619 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d7b6d84b-f757-486c-9f47-2825680ec460 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.149884 Jul 26 16:33:14.164182 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 61/131] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:14 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:14.198073 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-52ffbce8-bec7-4e59-b6bb-eebf1fda6165 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:14.198697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-52ffbce8-bec7-4e59-b6bb-eebf1fda6165 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:14.204702 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-52ffbce8-bec7-4e59-b6bb-eebf1fda6165 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:14.205159 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-52ffbce8-bec7-4e59-b6bb-eebf1fda6165 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:14.206254 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-52ffbce8-bec7-4e59-b6bb-eebf1fda6165 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:14.206688 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-52ffbce8-bec7-4e59-b6bb-eebf1fda6165 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:14.351057 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-52ffbce8-bec7-4e59-b6bb-eebf1fda6165 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:14.359207 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-52ffbce8-bec7-4e59-b6bb-eebf1fda6165 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.164893 Jul 26 16:33:14.360591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 71/132] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:14 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:14.482910 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7533907a-f0d7-40cc-afb9-34ce57c9ab05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:14.490773 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7533907a-f0d7-40cc-afb9-34ce57c9ab05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:14.507522 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7533907a-f0d7-40cc-afb9-34ce57c9ab05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:14.516216 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7533907a-f0d7-40cc-afb9-34ce57c9ab05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:14.517465 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7533907a-f0d7-40cc-afb9-34ce57c9ab05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:14.519621 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7533907a-f0d7-40cc-afb9-34ce57c9ab05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:14.799165 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7533907a-f0d7-40cc-afb9-34ce57c9ab05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:14.820827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7533907a-f0d7-40cc-afb9-34ce57c9ab05 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.352069 Jul 26 16:33:14.821426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 62/133] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:14 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:15.033171 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4ef4417e-6b9b-4985-b3c2-8a520f1d4ecd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:15.034559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4ef4417e-6b9b-4985-b3c2-8a520f1d4ecd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:15.046583 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4ef4417e-6b9b-4985-b3c2-8a520f1d4ecd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:15.052662 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4ef4417e-6b9b-4985-b3c2-8a520f1d4ecd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:15.053716 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4ef4417e-6b9b-4985-b3c2-8a520f1d4ecd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:15.054296 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4ef4417e-6b9b-4985-b3c2-8a520f1d4ecd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:15.183409 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9d36e526-0402-459f-a8b4-fe7e07db55fe tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:15.183998 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9d36e526-0402-459f-a8b4-fe7e07db55fe tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:15.196883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d36e526-0402-459f-a8b4-fe7e07db55fe tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:15.197657 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d36e526-0402-459f-a8b4-fe7e07db55fe tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:15.198654 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d36e526-0402-459f-a8b4-fe7e07db55fe tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:15.199272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d36e526-0402-459f-a8b4-fe7e07db55fe tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:15.252714 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:15.253114 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4ef4417e-6b9b-4985-b3c2-8a520f1d4ecd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:15.262240 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4ef4417e-6b9b-4985-b3c2-8a520f1d4ecd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.233672 Jul 26 16:33:15.283464 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 72/134] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:15 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:15.372541 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9d36e526-0402-459f-a8b4-fe7e07db55fe tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:15.380276 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3596f2e6-b66f-4525-84dc-60bd2db324e8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:15.380873 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9d36e526-0402-459f-a8b4-fe7e07db55fe tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.201068 Jul 26 16:33:15.381298 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3596f2e6-b66f-4525-84dc-60bd2db324e8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:15.381600 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 63/135] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:15 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:15.393629 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3596f2e6-b66f-4525-84dc-60bd2db324e8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:15.394141 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3596f2e6-b66f-4525-84dc-60bd2db324e8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:15.395378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3596f2e6-b66f-4525-84dc-60bd2db324e8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:15.395841 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3596f2e6-b66f-4525-84dc-60bd2db324e8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:15.402174 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:15.535329 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3596f2e6-b66f-4525-84dc-60bd2db324e8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:15.544040 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3596f2e6-b66f-4525-84dc-60bd2db324e8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.168090 Jul 26 16:33:15.545041 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 73/136] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:15 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:15.842148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2933e25f-9acd-46a8-b794-76a0f7520932 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:15.842694 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2933e25f-9acd-46a8-b794-76a0f7520932 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:15.849392 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2933e25f-9acd-46a8-b794-76a0f7520932 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:15.849899 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2933e25f-9acd-46a8-b794-76a0f7520932 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:15.850597 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2933e25f-9acd-46a8-b794-76a0f7520932 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:15.851029 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2933e25f-9acd-46a8-b794-76a0f7520932 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:15.989691 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2933e25f-9acd-46a8-b794-76a0f7520932 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:15.998325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2933e25f-9acd-46a8-b794-76a0f7520932 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.160025 Jul 26 16:33:15.999068 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 64/137] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:15 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:16.290650 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8ccd797e-1935-4770-a658-40d10cc39cd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:16.291287 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8ccd797e-1935-4770-a658-40d10cc39cd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:16.297314 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ccd797e-1935-4770-a658-40d10cc39cd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:16.297754 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ccd797e-1935-4770-a658-40d10cc39cd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:16.298497 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ccd797e-1935-4770-a658-40d10cc39cd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:16.298921 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ccd797e-1935-4770-a658-40d10cc39cd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:16.364912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8ccd797e-1935-4770-a658-40d10cc39cd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:16.372542 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8ccd797e-1935-4770-a658-40d10cc39cd3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.085605 Jul 26 16:33:16.380699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 74/138] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:16 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:16.402985 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d07f0193-145c-4ef4-a578-ec9fc9af94bb tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:16.403720 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d07f0193-145c-4ef4-a578-ec9fc9af94bb tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:16.410067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d07f0193-145c-4ef4-a578-ec9fc9af94bb tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:16.411061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d07f0193-145c-4ef4-a578-ec9fc9af94bb tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:16.411826 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d07f0193-145c-4ef4-a578-ec9fc9af94bb tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:16.412258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d07f0193-145c-4ef4-a578-ec9fc9af94bb tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:16.564605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d07f0193-145c-4ef4-a578-ec9fc9af94bb tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:16.569362 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-22ad61c3-d83b-4d9d-a5fd-c7b07495e19e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:16.571601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-22ad61c3-d83b-4d9d-a5fd-c7b07495e19e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:16.574116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d07f0193-145c-4ef4-a578-ec9fc9af94bb tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.176476 Jul 26 16:33:16.574765 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 65/139] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:16 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:16.591713 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-22ad61c3-d83b-4d9d-a5fd-c7b07495e19e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:16.592196 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-22ad61c3-d83b-4d9d-a5fd-c7b07495e19e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:16.593011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-22ad61c3-d83b-4d9d-a5fd-c7b07495e19e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:16.593447 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-22ad61c3-d83b-4d9d-a5fd-c7b07495e19e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:16.742461 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-22ad61c3-d83b-4d9d-a5fd-c7b07495e19e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:16.750870 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-22ad61c3-d83b-4d9d-a5fd-c7b07495e19e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.188038 Jul 26 16:33:16.751733 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 75/140] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:16 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:17.021286 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6218c250-45c6-4281-9fb0-78c61269414a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:17.022418 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6218c250-45c6-4281-9fb0-78c61269414a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:17.029858 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6218c250-45c6-4281-9fb0-78c61269414a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:17.037134 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6218c250-45c6-4281-9fb0-78c61269414a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:17.037134 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6218c250-45c6-4281-9fb0-78c61269414a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:17.037134 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6218c250-45c6-4281-9fb0-78c61269414a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:17.170177 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6218c250-45c6-4281-9fb0-78c61269414a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:17.178078 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6218c250-45c6-4281-9fb0-78c61269414a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.160638 Jul 26 16:33:17.178639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 66/141] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:17 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:17.394390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0a4bea97-0dfa-4915-8dab-0e060639fe50 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:17.395777 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0a4bea97-0dfa-4915-8dab-0e060639fe50 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:17.402706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0a4bea97-0dfa-4915-8dab-0e060639fe50 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:17.403191 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0a4bea97-0dfa-4915-8dab-0e060639fe50 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:17.403989 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0a4bea97-0dfa-4915-8dab-0e060639fe50 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:17.404493 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0a4bea97-0dfa-4915-8dab-0e060639fe50 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:17.475887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0a4bea97-0dfa-4915-8dab-0e060639fe50 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:17.483944 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0a4bea97-0dfa-4915-8dab-0e060639fe50 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1293 microversion: 2.1 time: 0.093349 Jul 26 16:33:17.484759 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 76/142] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:17 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:17.594968 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-162e087e-adfa-4f5b-9c41-1e9fdf857c8a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:17.597002 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-162e087e-adfa-4f5b-9c41-1e9fdf857c8a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:17.605800 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-162e087e-adfa-4f5b-9c41-1e9fdf857c8a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:17.606458 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-162e087e-adfa-4f5b-9c41-1e9fdf857c8a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:17.607235 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-162e087e-adfa-4f5b-9c41-1e9fdf857c8a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:17.607822 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-162e087e-adfa-4f5b-9c41-1e9fdf857c8a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:17.763739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-162e087e-adfa-4f5b-9c41-1e9fdf857c8a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:17.774205 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0eaa6d7a-d52f-4db1-91f6-9d09d9be7120 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:17.777951 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0eaa6d7a-d52f-4db1-91f6-9d09d9be7120 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:17.782105 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0eaa6d7a-d52f-4db1-91f6-9d09d9be7120 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:17.782806 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0eaa6d7a-d52f-4db1-91f6-9d09d9be7120 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:17.783796 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0eaa6d7a-d52f-4db1-91f6-9d09d9be7120 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:17.784722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0eaa6d7a-d52f-4db1-91f6-9d09d9be7120 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:17.786936 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-162e087e-adfa-4f5b-9c41-1e9fdf857c8a tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.194399 Jul 26 16:33:17.796136 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 67/143] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:17 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:17.946020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0eaa6d7a-d52f-4db1-91f6-9d09d9be7120 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:17.953326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0eaa6d7a-d52f-4db1-91f6-9d09d9be7120 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1337 microversion: 2.1 time: 0.185319 Jul 26 16:33:17.953975 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 77/144] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:17 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1337 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:18.198789 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cf588375-58e1-4ebe-8cf9-35273a909eb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:18.199870 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cf588375-58e1-4ebe-8cf9-35273a909eb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:18.205823 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cf588375-58e1-4ebe-8cf9-35273a909eb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:18.206337 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cf588375-58e1-4ebe-8cf9-35273a909eb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:18.210810 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cf588375-58e1-4ebe-8cf9-35273a909eb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:18.210810 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cf588375-58e1-4ebe-8cf9-35273a909eb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:18.347509 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cf588375-58e1-4ebe-8cf9-35273a909eb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:18.355082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cf588375-58e1-4ebe-8cf9-35273a909eb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.160131 Jul 26 16:33:18.355643 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 68/145] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:18 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:18.507367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8ea2f5ad-2ff8-4d91-9c90-5b01f30f7bba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:18.511936 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8ea2f5ad-2ff8-4d91-9c90-5b01f30f7bba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:18.514293 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ea2f5ad-2ff8-4d91-9c90-5b01f30f7bba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:18.514997 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ea2f5ad-2ff8-4d91-9c90-5b01f30f7bba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:18.515842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ea2f5ad-2ff8-4d91-9c90-5b01f30f7bba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:18.516450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ea2f5ad-2ff8-4d91-9c90-5b01f30f7bba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:18.606759 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8ea2f5ad-2ff8-4d91-9c90-5b01f30f7bba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:18.620657 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8ea2f5ad-2ff8-4d91-9c90-5b01f30f7bba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1301 microversion: 2.1 time: 0.116196 Jul 26 16:33:18.624145 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 78/146] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:18 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1301 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:18.814247 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-65d719ea-9114-4e3c-825b-3403884bf529 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:18.814247 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-65d719ea-9114-4e3c-825b-3403884bf529 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:18.825507 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-65d719ea-9114-4e3c-825b-3403884bf529 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:18.826171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-65d719ea-9114-4e3c-825b-3403884bf529 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:18.827109 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-65d719ea-9114-4e3c-825b-3403884bf529 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:18.827697 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-65d719ea-9114-4e3c-825b-3403884bf529 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:18.975310 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9e370079-3cff-4f64-a2fc-4271bde5f97f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:18.975934 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9e370079-3cff-4f64-a2fc-4271bde5f97f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:18.997626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9e370079-3cff-4f64-a2fc-4271bde5f97f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:18.997626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9e370079-3cff-4f64-a2fc-4271bde5f97f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:18.997626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9e370079-3cff-4f64-a2fc-4271bde5f97f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:18.997626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9e370079-3cff-4f64-a2fc-4271bde5f97f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:19.249376 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-65d719ea-9114-4e3c-825b-3403884bf529 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:19.270884 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-65d719ea-9114-4e3c-825b-3403884bf529 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.452033 Jul 26 16:33:19.271669 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 69/147] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:18 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:19.379752 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f9d3ef4a-1a1c-48e1-807f-ba76e90df09c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:19.380794 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f9d3ef4a-1a1c-48e1-807f-ba76e90df09c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:19.400642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9d3ef4a-1a1c-48e1-807f-ba76e90df09c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:19.401103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9d3ef4a-1a1c-48e1-807f-ba76e90df09c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:19.401889 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9d3ef4a-1a1c-48e1-807f-ba76e90df09c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:19.402476 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9d3ef4a-1a1c-48e1-807f-ba76e90df09c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:19.757774 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9e370079-3cff-4f64-a2fc-4271bde5f97f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:19.772522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9e370079-3cff-4f64-a2fc-4271bde5f97f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.794406 Jul 26 16:33:19.772522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 79/148] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:18 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:19.772522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fbd325b2-f90c-4422-869e-dde2e42bb532 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:19.772522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fbd325b2-f90c-4422-869e-dde2e42bb532 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:19.790795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fbd325b2-f90c-4422-869e-dde2e42bb532 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:19.791317 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fbd325b2-f90c-4422-869e-dde2e42bb532 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:19.792008 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fbd325b2-f90c-4422-869e-dde2e42bb532 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:19.792457 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fbd325b2-f90c-4422-869e-dde2e42bb532 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:19.801517 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f9d3ef4a-1a1c-48e1-807f-ba76e90df09c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:19.813654 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f9d3ef4a-1a1c-48e1-807f-ba76e90df09c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.441116 Jul 26 16:33:19.877541 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 70/149] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:19 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:19.933293 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fbd325b2-f90c-4422-869e-dde2e42bb532 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:19.940992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fbd325b2-f90c-4422-869e-dde2e42bb532 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1299 microversion: 2.1 time: 0.173676 Jul 26 16:33:19.942262 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 80/150] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:19 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:20.281515 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-17651923-16e9-4b3d-959c-c75741f03a74 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:20.282864 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-17651923-16e9-4b3d-959c-c75741f03a74 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:20.291406 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17651923-16e9-4b3d-959c-c75741f03a74 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:20.292032 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17651923-16e9-4b3d-959c-c75741f03a74 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:20.293317 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17651923-16e9-4b3d-959c-c75741f03a74 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:20.293969 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17651923-16e9-4b3d-959c-c75741f03a74 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:20.775824 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-17651923-16e9-4b3d-959c-c75741f03a74 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:20.792375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5d71cfea-603a-4e66-a007-915f1a38d70e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:20.793059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5d71cfea-603a-4e66-a007-915f1a38d70e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:20.806700 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-17651923-16e9-4b3d-959c-c75741f03a74 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.528952 Jul 26 16:33:20.809450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d71cfea-603a-4e66-a007-915f1a38d70e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:20.810836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 71/151] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:20 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:20.811031 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d71cfea-603a-4e66-a007-915f1a38d70e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:20.811960 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d71cfea-603a-4e66-a007-915f1a38d70e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:20.812575 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d71cfea-603a-4e66-a007-915f1a38d70e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:20.903652 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1009b6f4-ead2-4d7b-9a58-e750fee5ad2e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:20.904923 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1009b6f4-ead2-4d7b-9a58-e750fee5ad2e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:20.925297 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1009b6f4-ead2-4d7b-9a58-e750fee5ad2e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:20.925874 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1009b6f4-ead2-4d7b-9a58-e750fee5ad2e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:20.926757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1009b6f4-ead2-4d7b-9a58-e750fee5ad2e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:20.927970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1009b6f4-ead2-4d7b-9a58-e750fee5ad2e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:21.280118 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5d71cfea-603a-4e66-a007-915f1a38d70e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:21.289091 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5d71cfea-603a-4e66-a007-915f1a38d70e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.502527 Jul 26 16:33:21.289979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 81/152] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:20 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:21.294663 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a0685861-55a5-4518-b235-c14f4c0ad43e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:21.295663 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a0685861-55a5-4518-b235-c14f4c0ad43e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:21.312091 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1009b6f4-ead2-4d7b-9a58-e750fee5ad2e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:21.329208 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1009b6f4-ead2-4d7b-9a58-e750fee5ad2e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.436016 Jul 26 16:33:21.333240 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 72/153] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:20 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:21.341325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a0685861-55a5-4518-b235-c14f4c0ad43e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:21.344379 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a0685861-55a5-4518-b235-c14f4c0ad43e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:21.345236 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a0685861-55a5-4518-b235-c14f4c0ad43e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:21.345672 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a0685861-55a5-4518-b235-c14f4c0ad43e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:21.583682 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a0685861-55a5-4518-b235-c14f4c0ad43e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:21.593445 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a0685861-55a5-4518-b235-c14f4c0ad43e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.302167 Jul 26 16:33:21.600405 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 82/154] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:21 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:21.702852 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-c90b5a1d-b22a-41dc-a8ee-80362436c0f2 req-fa96b997-2fdc-4223-ad0f-442f6d8cca28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad766a1-6214-4f3a-aa55-50ca2baa6b64", "tag": "16990b57-d241-4bda-9263-5fdbfd1138b4"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:21.718506 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-c90b5a1d-b22a-41dc-a8ee-80362436c0f2 req-fa96b997-2fdc-4223-ad0f-442f6d8cca28 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:21.719135 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-c90b5a1d-b22a-41dc-a8ee-80362436c0f2 req-fa96b997-2fdc-4223-ad0f-442f6d8cca28 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:21.740620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-c90b5a1d-b22a-41dc-a8ee-80362436c0f2 req-fa96b997-2fdc-4223-ad0f-442f6d8cca28 service nova] Creating event network-changed:16990b57-d241-4bda-9263-5fdbfd1138b4 for instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 on hv-cinder-85104 Jul 26 16:33:21.741600 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-c90b5a1d-b22a-41dc-a8ee-80362436c0f2 req-fa96b997-2fdc-4223-ad0f-442f6d8cca28 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124820) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 16:33:21.742932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-330f4ddf-6cce-4b7c-8dbf-1f57f4471748 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:21.743541 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-330f4ddf-6cce-4b7c-8dbf-1f57f4471748 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:21.744515 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-330f4ddf-6cce-4b7c-8dbf-1f57f4471748 None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:21.745127 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-330f4ddf-6cce-4b7c-8dbf-1f57f4471748 None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:21.756883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.compute.rpcapi [None req-330f4ddf-6cce-4b7c-8dbf-1f57f4471748 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 16:33:21.757799 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-330f4ddf-6cce-4b7c-8dbf-1f57f4471748 None None] Releasing lock "compute-rpcapi-router" {{(pid=124820) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 16:33:21.810174 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-330f4ddf-6cce-4b7c-8dbf-1f57f4471748 None None] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175055 Jul 26 16:33:21.810761 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 73/155] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:33:21.841316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a422b2ab-ef92-4985-b751-ac211138ec90 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:21.845058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a422b2ab-ef92-4985-b751-ac211138ec90 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:21.859291 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a422b2ab-ef92-4985-b751-ac211138ec90 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:21.860945 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a422b2ab-ef92-4985-b751-ac211138ec90 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:21.864971 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a422b2ab-ef92-4985-b751-ac211138ec90 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:21.865495 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a422b2ab-ef92-4985-b751-ac211138ec90 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:21.954163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-bb828888-7ba5-4af8-893e-dc0581273eb9 req-3ae69a35-5e75-4788-894c-d3c5ddfc6adc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4", "tag": "26e755d4-3673-4a1f-82d7-5cb16e9faf7f"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:21.968350 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-bb828888-7ba5-4af8-893e-dc0581273eb9 req-3ae69a35-5e75-4788-894c-d3c5ddfc6adc service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:21.969065 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-bb828888-7ba5-4af8-893e-dc0581273eb9 req-3ae69a35-5e75-4788-894c-d3c5ddfc6adc service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:21.990261 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-bb828888-7ba5-4af8-893e-dc0581273eb9 req-3ae69a35-5e75-4788-894c-d3c5ddfc6adc service nova] Creating event network-changed:26e755d4-3673-4a1f-82d7-5cb16e9faf7f for instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 on hv-cinder-85104 Jul 26 16:33:21.991126 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-bb828888-7ba5-4af8-893e-dc0581273eb9 req-3ae69a35-5e75-4788-894c-d3c5ddfc6adc service nova] Acquired lock "compute-rpcapi-router" {{(pid=124821) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 26 16:33:21.992466 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-daa56e90-c594-4498-9cbe-1a23e75f4dd8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:21.993079 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-daa56e90-c594-4498-9cbe-1a23e75f4dd8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:21.995284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-daa56e90-c594-4498-9cbe-1a23e75f4dd8 None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:21.995903 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-daa56e90-c594-4498-9cbe-1a23e75f4dd8 None None] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:22.006126 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.compute.rpcapi [None req-daa56e90-c594-4498-9cbe-1a23e75f4dd8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 26 16:33:22.008472 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-daa56e90-c594-4498-9cbe-1a23e75f4dd8 None None] Releasing lock "compute-rpcapi-router" {{(pid=124821) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 26 16:33:22.030031 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-daa56e90-c594-4498-9cbe-1a23e75f4dd8 None None] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207906 Jul 26 16:33:22.032140 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 83/156] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:33:22.280068 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a422b2ab-ef92-4985-b751-ac211138ec90 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:22.287881 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a422b2ab-ef92-4985-b751-ac211138ec90 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.457834 Jul 26 16:33:22.288980 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 74/157] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:21 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:22.310670 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8fab0911-7323-4fb6-a2ee-3970061e8e90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:22.311459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8fab0911-7323-4fb6-a2ee-3970061e8e90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:22.319542 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8fab0911-7323-4fb6-a2ee-3970061e8e90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:22.320024 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8fab0911-7323-4fb6-a2ee-3970061e8e90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:22.320821 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8fab0911-7323-4fb6-a2ee-3970061e8e90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:22.321256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8fab0911-7323-4fb6-a2ee-3970061e8e90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:22.359163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4900f0a8-2015-4a51-ba0e-ce62e37d5cef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:22.359996 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4900f0a8-2015-4a51-ba0e-ce62e37d5cef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:22.371567 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4900f0a8-2015-4a51-ba0e-ce62e37d5cef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:22.372401 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4900f0a8-2015-4a51-ba0e-ce62e37d5cef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:22.376882 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4900f0a8-2015-4a51-ba0e-ce62e37d5cef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:22.378552 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4900f0a8-2015-4a51-ba0e-ce62e37d5cef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:22.523285 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8fab0911-7323-4fb6-a2ee-3970061e8e90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:22.548470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8fab0911-7323-4fb6-a2ee-3970061e8e90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.242290 Jul 26 16:33:22.549067 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 84/158] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:22 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:22.614513 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4900f0a8-2015-4a51-ba0e-ce62e37d5cef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:22.619791 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4900f0a8-2015-4a51-ba0e-ce62e37d5cef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.266980 Jul 26 16:33:22.620424 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 75/159] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:22 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:22.633712 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-09787c00-598f-448a-bc7a-a137ba95d3e1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:22.634446 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-09787c00-598f-448a-bc7a-a137ba95d3e1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:22.641256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-09787c00-598f-448a-bc7a-a137ba95d3e1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:22.644850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-09787c00-598f-448a-bc7a-a137ba95d3e1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:22.646647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-09787c00-598f-448a-bc7a-a137ba95d3e1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:22.647285 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-09787c00-598f-448a-bc7a-a137ba95d3e1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:22.811548 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-09787c00-598f-448a-bc7a-a137ba95d3e1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:22.822345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-09787c00-598f-448a-bc7a-a137ba95d3e1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.192865 Jul 26 16:33:22.822920 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 85/160] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:22 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:23.309400 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3f95b239-87ad-4c50-9857-3055b7feb744 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:23.310067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3f95b239-87ad-4c50-9857-3055b7feb744 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:23.315982 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f95b239-87ad-4c50-9857-3055b7feb744 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:23.316512 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f95b239-87ad-4c50-9857-3055b7feb744 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:23.317767 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f95b239-87ad-4c50-9857-3055b7feb744 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:23.318198 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f95b239-87ad-4c50-9857-3055b7feb744 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:23.454968 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3f95b239-87ad-4c50-9857-3055b7feb744 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:23.462819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3f95b239-87ad-4c50-9857-3055b7feb744 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.157345 Jul 26 16:33:23.463372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 76/161] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:23 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:23.570001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d8880a22-dc3a-469c-abf3-d30dc91f068f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:23.570609 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d8880a22-dc3a-469c-abf3-d30dc91f068f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:23.576523 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d8880a22-dc3a-469c-abf3-d30dc91f068f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:23.577036 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d8880a22-dc3a-469c-abf3-d30dc91f068f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:23.577727 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d8880a22-dc3a-469c-abf3-d30dc91f068f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:23.578151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d8880a22-dc3a-469c-abf3-d30dc91f068f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:23.643503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c4e2c570-ad65-45c1-b457-f9bc02d36b68 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:23.644201 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c4e2c570-ad65-45c1-b457-f9bc02d36b68 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:23.650968 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c4e2c570-ad65-45c1-b457-f9bc02d36b68 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:23.651695 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c4e2c570-ad65-45c1-b457-f9bc02d36b68 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:23.652493 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c4e2c570-ad65-45c1-b457-f9bc02d36b68 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:23.652926 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c4e2c570-ad65-45c1-b457-f9bc02d36b68 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:23.713144 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d8880a22-dc3a-469c-abf3-d30dc91f068f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:23.720701 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d8880a22-dc3a-469c-abf3-d30dc91f068f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.155183 Jul 26 16:33:23.721272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 86/162] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:23 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:23.781107 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c4e2c570-ad65-45c1-b457-f9bc02d36b68 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:23.790071 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c4e2c570-ad65-45c1-b457-f9bc02d36b68 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.151757 Jul 26 16:33:23.790640 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 77/163] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:23 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:23.843255 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-94ba1aa2-d65c-40ec-9e74-f1da31f1b334 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:23.843867 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-94ba1aa2-d65c-40ec-9e74-f1da31f1b334 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:23.851712 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-94ba1aa2-d65c-40ec-9e74-f1da31f1b334 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:23.851712 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-94ba1aa2-d65c-40ec-9e74-f1da31f1b334 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:23.851956 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-b9de2391-f103-401d-bf43-11a147486e9c req-b49395ec-ea29-45fc-a081-d605d5bd19be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a999303-ed3e-4e86-b4f3-4d04e1aec162", "tag": "bf8c65dd-f0b9-4fd7-9a7b-bffc6f90dd01"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:23.852448 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-94ba1aa2-d65c-40ec-9e74-f1da31f1b334 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:23.852891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-94ba1aa2-d65c-40ec-9e74-f1da31f1b334 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:23.861485 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-b9de2391-f103-401d-bf43-11a147486e9c req-b49395ec-ea29-45fc-a081-d605d5bd19be service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:23.861924 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-b9de2391-f103-401d-bf43-11a147486e9c req-b49395ec-ea29-45fc-a081-d605d5bd19be service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:23.873065 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-b9de2391-f103-401d-bf43-11a147486e9c req-b49395ec-ea29-45fc-a081-d605d5bd19be service nova] Creating event network-changed:bf8c65dd-f0b9-4fd7-9a7b-bffc6f90dd01 for instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 on hv-cinder-85104 Jul 26 16:33:23.878244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-b9de2391-f103-401d-bf43-11a147486e9c req-b49395ec-ea29-45fc-a081-d605d5bd19be service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030169 Jul 26 16:33:23.879645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 78/164] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:33:23.986373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-94ba1aa2-d65c-40ec-9e74-f1da31f1b334 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:23.994584 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-94ba1aa2-d65c-40ec-9e74-f1da31f1b334 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.155303 Jul 26 16:33:23.995179 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 87/165] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:23 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:24.062176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-8dc6b3ec-b5cf-4bc4-9962-8ca8f30e45ab req-3f7d893e-1f04-4305-8b64-25a58d79b8af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ee205ae-99c2-4fe2-8160-e336188072b0", "tag": "8ff0a433-a61a-4d2f-8754-b2d35e4d59b4"}, {"name": "network-changed", "server_uuid": "10c1c021-13e8-4f87-bcff-9bac39392b1e", "tag": "a5df5a50-4c77-4fe7-abd3-ff061e50b15d"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:24.070064 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-8dc6b3ec-b5cf-4bc4-9962-8ca8f30e45ab req-3f7d893e-1f04-4305-8b64-25a58d79b8af service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:24.070536 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-8dc6b3ec-b5cf-4bc4-9962-8ca8f30e45ab req-3f7d893e-1f04-4305-8b64-25a58d79b8af service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:24.083213 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-8dc6b3ec-b5cf-4bc4-9962-8ca8f30e45ab req-3f7d893e-1f04-4305-8b64-25a58d79b8af service nova] Creating event network-changed:8ff0a433-a61a-4d2f-8754-b2d35e4d59b4 for instance 5ee205ae-99c2-4fe2-8160-e336188072b0 on hv-cinder-85104 Jul 26 16:33:24.083706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-8dc6b3ec-b5cf-4bc4-9962-8ca8f30e45ab req-3f7d893e-1f04-4305-8b64-25a58d79b8af service nova] Creating event network-changed:a5df5a50-4c77-4fe7-abd3-ff061e50b15d for instance 10c1c021-13e8-4f87-bcff-9bac39392b1e on hv-cinder-85104 Jul 26 16:33:24.090160 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-8dc6b3ec-b5cf-4bc4-9962-8ca8f30e45ab req-3f7d893e-1f04-4305-8b64-25a58d79b8af service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044971 Jul 26 16:33:24.090744 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 79/166] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:33:24.486475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-64b5bc4c-869e-4d64-8945-bd1f8f53d5e9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:24.487077 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-64b5bc4c-869e-4d64-8945-bd1f8f53d5e9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:24.494012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64b5bc4c-869e-4d64-8945-bd1f8f53d5e9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:24.494467 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64b5bc4c-869e-4d64-8945-bd1f8f53d5e9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:24.495241 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64b5bc4c-869e-4d64-8945-bd1f8f53d5e9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:24.495677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64b5bc4c-869e-4d64-8945-bd1f8f53d5e9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:24.624668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-64b5bc4c-869e-4d64-8945-bd1f8f53d5e9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:24.632592 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-64b5bc4c-869e-4d64-8945-bd1f8f53d5e9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.149947 Jul 26 16:33:24.633154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 88/167] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:24 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:24.742132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e6aa51ba-e97d-47f8-b942-099e8a7a4f07 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:24.742830 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e6aa51ba-e97d-47f8-b942-099e8a7a4f07 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:24.749060 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e6aa51ba-e97d-47f8-b942-099e8a7a4f07 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:24.749507 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e6aa51ba-e97d-47f8-b942-099e8a7a4f07 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:24.750261 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e6aa51ba-e97d-47f8-b942-099e8a7a4f07 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:24.750723 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e6aa51ba-e97d-47f8-b942-099e8a7a4f07 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:24.811275 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-811f1ab7-11e1-45a0-adae-2d33b1adf734 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:24.811885 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-811f1ab7-11e1-45a0-adae-2d33b1adf734 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:24.818374 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-811f1ab7-11e1-45a0-adae-2d33b1adf734 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:24.818864 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-811f1ab7-11e1-45a0-adae-2d33b1adf734 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:24.819700 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-811f1ab7-11e1-45a0-adae-2d33b1adf734 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:24.820132 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-811f1ab7-11e1-45a0-adae-2d33b1adf734 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:24.881372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e6aa51ba-e97d-47f8-b942-099e8a7a4f07 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:24.890684 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e6aa51ba-e97d-47f8-b942-099e8a7a4f07 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.152596 Jul 26 16:33:24.897331 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 80/168] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:24 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:24.958216 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-811f1ab7-11e1-45a0-adae-2d33b1adf734 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:24.965677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-811f1ab7-11e1-45a0-adae-2d33b1adf734 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.158328 Jul 26 16:33:24.966273 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 89/169] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:24 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:25.015239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bde572df-f2c7-4914-bd7b-0cdc1c6aa6c9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:25.015840 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bde572df-f2c7-4914-bd7b-0cdc1c6aa6c9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:25.022402 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bde572df-f2c7-4914-bd7b-0cdc1c6aa6c9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:25.022848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bde572df-f2c7-4914-bd7b-0cdc1c6aa6c9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:25.023603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bde572df-f2c7-4914-bd7b-0cdc1c6aa6c9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:25.024030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bde572df-f2c7-4914-bd7b-0cdc1c6aa6c9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:25.280627 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bde572df-f2c7-4914-bd7b-0cdc1c6aa6c9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:25.286406 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:25.291825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bde572df-f2c7-4914-bd7b-0cdc1c6aa6c9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.280618 Jul 26 16:33:25.292916 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 81/170] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:25 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:25.659697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-30d443e3-8948-4d0f-8a76-9b30c7373ec3 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:25.664021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-30d443e3-8948-4d0f-8a76-9b30c7373ec3 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:25.671219 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-30d443e3-8948-4d0f-8a76-9b30c7373ec3 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:25.671888 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-30d443e3-8948-4d0f-8a76-9b30c7373ec3 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:25.672837 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-30d443e3-8948-4d0f-8a76-9b30c7373ec3 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:25.673409 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-30d443e3-8948-4d0f-8a76-9b30c7373ec3 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:25.678869 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:25.912233 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a10fe346-60a6-4ee9-9b30-bd304c2e6a85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:25.913657 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a10fe346-60a6-4ee9-9b30-bd304c2e6a85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:25.920889 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a10fe346-60a6-4ee9-9b30-bd304c2e6a85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:25.921468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a10fe346-60a6-4ee9-9b30-bd304c2e6a85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:25.922262 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a10fe346-60a6-4ee9-9b30-bd304c2e6a85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:25.923498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a10fe346-60a6-4ee9-9b30-bd304c2e6a85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:26.277457 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a10fe346-60a6-4ee9-9b30-bd304c2e6a85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:26.294530 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a10fe346-60a6-4ee9-9b30-bd304c2e6a85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.386753 Jul 26 16:33:26.295361 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 82/171] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:25 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:26.302594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6d51e1dd-9f30-4d89-abe0-608943ee37b8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:26.303478 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6d51e1dd-9f30-4d89-abe0-608943ee37b8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:26.316104 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d51e1dd-9f30-4d89-abe0-608943ee37b8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:26.316883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d51e1dd-9f30-4d89-abe0-608943ee37b8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:26.317818 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d51e1dd-9f30-4d89-abe0-608943ee37b8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:26.318568 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d51e1dd-9f30-4d89-abe0-608943ee37b8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:26.496225 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-30d443e3-8948-4d0f-8a76-9b30c7373ec3 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:26.509920 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-30d443e3-8948-4d0f-8a76-9b30c7373ec3 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.856692 Jul 26 16:33:26.511037 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 90/172] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:25 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:26.516552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-10b8206a-6294-40f3-b2e9-32be9aea4ef3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:26.517187 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-10b8206a-6294-40f3-b2e9-32be9aea4ef3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:26.531111 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-10b8206a-6294-40f3-b2e9-32be9aea4ef3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:26.532151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-10b8206a-6294-40f3-b2e9-32be9aea4ef3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:26.534411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-10b8206a-6294-40f3-b2e9-32be9aea4ef3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:26.535860 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-10b8206a-6294-40f3-b2e9-32be9aea4ef3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:26.612427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6d51e1dd-9f30-4d89-abe0-608943ee37b8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:26.623999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6d51e1dd-9f30-4d89-abe0-608943ee37b8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.327396 Jul 26 16:33:26.624602 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 83/173] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:26 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:26.896694 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-10b8206a-6294-40f3-b2e9-32be9aea4ef3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:26.911971 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-10b8206a-6294-40f3-b2e9-32be9aea4ef3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.395108 Jul 26 16:33:26.912680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 91/174] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:26 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:27.318090 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-129c4d60-84e3-4307-961a-141f15bb9b18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:27.318606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-129c4d60-84e3-4307-961a-141f15bb9b18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:27.324583 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-129c4d60-84e3-4307-961a-141f15bb9b18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:27.325024 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-129c4d60-84e3-4307-961a-141f15bb9b18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:27.325767 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-129c4d60-84e3-4307-961a-141f15bb9b18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:27.326191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-129c4d60-84e3-4307-961a-141f15bb9b18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:27.470691 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-129c4d60-84e3-4307-961a-141f15bb9b18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:27.483965 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-129c4d60-84e3-4307-961a-141f15bb9b18 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.170252 Jul 26 16:33:27.485490 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 84/175] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:27 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:27.531262 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a27d961c-82b1-4d18-bdc4-f988d471a532 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:27.531941 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a27d961c-82b1-4d18-bdc4-f988d471a532 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:27.538899 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a27d961c-82b1-4d18-bdc4-f988d471a532 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:27.539563 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a27d961c-82b1-4d18-bdc4-f988d471a532 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:27.540327 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a27d961c-82b1-4d18-bdc4-f988d471a532 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:27.540781 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a27d961c-82b1-4d18-bdc4-f988d471a532 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:27.646956 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2584a0b6-6ad0-4db5-a069-c67d4b9979f2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:27.647545 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2584a0b6-6ad0-4db5-a069-c67d4b9979f2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:27.653528 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2584a0b6-6ad0-4db5-a069-c67d4b9979f2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:27.654050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2584a0b6-6ad0-4db5-a069-c67d4b9979f2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:27.654835 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2584a0b6-6ad0-4db5-a069-c67d4b9979f2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:27.655261 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2584a0b6-6ad0-4db5-a069-c67d4b9979f2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:27.692823 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a27d961c-82b1-4d18-bdc4-f988d471a532 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:27.701687 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a27d961c-82b1-4d18-bdc4-f988d471a532 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.173480 Jul 26 16:33:27.701687 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 92/176] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:27 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:27.795934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2584a0b6-6ad0-4db5-a069-c67d4b9979f2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:27.804520 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2584a0b6-6ad0-4db5-a069-c67d4b9979f2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.161414 Jul 26 16:33:27.805120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 85/177] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:27 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:27.932378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a62db674-0278-4aaf-a7b8-c313572ca0ba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:27.933265 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a62db674-0278-4aaf-a7b8-c313572ca0ba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:27.938884 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a62db674-0278-4aaf-a7b8-c313572ca0ba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:27.939328 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a62db674-0278-4aaf-a7b8-c313572ca0ba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:27.940067 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a62db674-0278-4aaf-a7b8-c313572ca0ba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:27.940593 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a62db674-0278-4aaf-a7b8-c313572ca0ba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:28.071913 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a62db674-0278-4aaf-a7b8-c313572ca0ba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:28.079983 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a62db674-0278-4aaf-a7b8-c313572ca0ba tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.151270 Jul 26 16:33:28.080584 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 93/178] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:27 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:28.505875 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f83dc839-b3f1-4943-9e9a-60551d981ab7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:28.506490 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f83dc839-b3f1-4943-9e9a-60551d981ab7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:28.512663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f83dc839-b3f1-4943-9e9a-60551d981ab7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:28.513108 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f83dc839-b3f1-4943-9e9a-60551d981ab7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:28.513882 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f83dc839-b3f1-4943-9e9a-60551d981ab7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:28.514307 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f83dc839-b3f1-4943-9e9a-60551d981ab7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:28.686706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f83dc839-b3f1-4943-9e9a-60551d981ab7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:28.701546 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f83dc839-b3f1-4943-9e9a-60551d981ab7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.199423 Jul 26 16:33:28.702112 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 86/179] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:28 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:28.721901 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6f185cb6-87a4-4faf-a86e-2a20099034f2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:28.723051 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6f185cb6-87a4-4faf-a86e-2a20099034f2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:28.728912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:28.732607 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f185cb6-87a4-4faf-a86e-2a20099034f2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:28.732607 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f185cb6-87a4-4faf-a86e-2a20099034f2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:28.732607 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f185cb6-87a4-4faf-a86e-2a20099034f2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:28.732607 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f185cb6-87a4-4faf-a86e-2a20099034f2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:28.825880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0c41f529-fbd0-4ebd-9b42-7c97bd4d7b14 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:28.826661 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0c41f529-fbd0-4ebd-9b42-7c97bd4d7b14 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:28.833298 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0c41f529-fbd0-4ebd-9b42-7c97bd4d7b14 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:28.833825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0c41f529-fbd0-4ebd-9b42-7c97bd4d7b14 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:28.834691 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0c41f529-fbd0-4ebd-9b42-7c97bd4d7b14 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:28.835198 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0c41f529-fbd0-4ebd-9b42-7c97bd4d7b14 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:28.864584 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6f185cb6-87a4-4faf-a86e-2a20099034f2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:28.872181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6f185cb6-87a4-4faf-a86e-2a20099034f2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.155515 Jul 26 16:33:28.872778 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 94/180] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:28 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:28.972705 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0c41f529-fbd0-4ebd-9b42-7c97bd4d7b14 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:28.980632 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0c41f529-fbd0-4ebd-9b42-7c97bd4d7b14 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.158447 Jul 26 16:33:28.981195 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 87/181] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:28 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:29.105742 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4796794e-f0b3-47a9-91bc-9e2f64625a31 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:29.105742 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4796794e-f0b3-47a9-91bc-9e2f64625a31 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:29.109328 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4796794e-f0b3-47a9-91bc-9e2f64625a31 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:29.109765 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4796794e-f0b3-47a9-91bc-9e2f64625a31 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:29.110504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4796794e-f0b3-47a9-91bc-9e2f64625a31 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:29.110927 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4796794e-f0b3-47a9-91bc-9e2f64625a31 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:29.255251 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4796794e-f0b3-47a9-91bc-9e2f64625a31 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:29.263214 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4796794e-f0b3-47a9-91bc-9e2f64625a31 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.164930 Jul 26 16:33:29.263883 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 95/182] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:29 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:29.724116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2368c20a-ca94-4617-b88d-90288e707615 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:29.724905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2368c20a-ca94-4617-b88d-90288e707615 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:29.733667 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2368c20a-ca94-4617-b88d-90288e707615 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:29.735951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2368c20a-ca94-4617-b88d-90288e707615 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:29.736848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2368c20a-ca94-4617-b88d-90288e707615 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:29.737290 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2368c20a-ca94-4617-b88d-90288e707615 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:29.887085 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2368c20a-ca94-4617-b88d-90288e707615 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:29.892227 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dfc6e646-2d13-4307-8eba-28b42ff013bc tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:29.892859 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dfc6e646-2d13-4307-8eba-28b42ff013bc tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:29.896905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2368c20a-ca94-4617-b88d-90288e707615 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.177123 Jul 26 16:33:29.897665 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 88/183] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:29 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:29.899558 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dfc6e646-2d13-4307-8eba-28b42ff013bc tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:29.903381 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dfc6e646-2d13-4307-8eba-28b42ff013bc tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:29.903381 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dfc6e646-2d13-4307-8eba-28b42ff013bc tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:29.903381 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dfc6e646-2d13-4307-8eba-28b42ff013bc tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:30.001239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5e07c77d-abe2-4b7b-9f44-7b1cbcd1e1f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:30.001986 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5e07c77d-abe2-4b7b-9f44-7b1cbcd1e1f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:30.010203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5e07c77d-abe2-4b7b-9f44-7b1cbcd1e1f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:30.011140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5e07c77d-abe2-4b7b-9f44-7b1cbcd1e1f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:30.012114 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5e07c77d-abe2-4b7b-9f44-7b1cbcd1e1f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:30.013115 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5e07c77d-abe2-4b7b-9f44-7b1cbcd1e1f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:30.053183 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-dfc6e646-2d13-4307-8eba-28b42ff013bc tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:30.062987 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dfc6e646-2d13-4307-8eba-28b42ff013bc tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.174459 Jul 26 16:33:30.076999 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 96/184] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:29 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:30.178448 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5e07c77d-abe2-4b7b-9f44-7b1cbcd1e1f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:30.185912 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5e07c77d-abe2-4b7b-9f44-7b1cbcd1e1f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.188518 Jul 26 16:33:30.186479 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 89/185] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:29 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:30.287105 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7b7b9541-586d-49e3-acbb-392e4ee8b91c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:30.288059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7b7b9541-586d-49e3-acbb-392e4ee8b91c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:30.294961 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7b7b9541-586d-49e3-acbb-392e4ee8b91c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:30.298897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7b7b9541-586d-49e3-acbb-392e4ee8b91c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:30.298897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7b7b9541-586d-49e3-acbb-392e4ee8b91c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:30.298897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7b7b9541-586d-49e3-acbb-392e4ee8b91c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:30.462038 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7b7b9541-586d-49e3-acbb-392e4ee8b91c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:30.478358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7b7b9541-586d-49e3-acbb-392e4ee8b91c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.195858 Jul 26 16:33:30.484873 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 97/186] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:30 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:30.921889 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-66438768-cfeb-4152-8b9c-13aadf19612e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:30.922475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-66438768-cfeb-4152-8b9c-13aadf19612e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:30.929922 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-66438768-cfeb-4152-8b9c-13aadf19612e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:30.930375 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-66438768-cfeb-4152-8b9c-13aadf19612e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:30.931126 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-66438768-cfeb-4152-8b9c-13aadf19612e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:30.931557 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-66438768-cfeb-4152-8b9c-13aadf19612e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:31.057927 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-66438768-cfeb-4152-8b9c-13aadf19612e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:31.065290 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-66438768-cfeb-4152-8b9c-13aadf19612e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.147371 Jul 26 16:33:31.065848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 90/187] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:30 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:31.086412 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8fae64ae-6bb7-498a-bbfe-fd5f74b3a259 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:31.087237 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8fae64ae-6bb7-498a-bbfe-fd5f74b3a259 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:31.094877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8fae64ae-6bb7-498a-bbfe-fd5f74b3a259 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:31.095465 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8fae64ae-6bb7-498a-bbfe-fd5f74b3a259 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:31.096466 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8fae64ae-6bb7-498a-bbfe-fd5f74b3a259 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:31.097157 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8fae64ae-6bb7-498a-bbfe-fd5f74b3a259 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:31.207003 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fb2a33f9-6e21-46d0-bbf0-3c6dfb5ca12e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:31.209128 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fb2a33f9-6e21-46d0-bbf0-3c6dfb5ca12e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:31.218001 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fb2a33f9-6e21-46d0-bbf0-3c6dfb5ca12e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:31.218754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fb2a33f9-6e21-46d0-bbf0-3c6dfb5ca12e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:31.220210 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fb2a33f9-6e21-46d0-bbf0-3c6dfb5ca12e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:31.220754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fb2a33f9-6e21-46d0-bbf0-3c6dfb5ca12e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:31.269586 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8fae64ae-6bb7-498a-bbfe-fd5f74b3a259 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:31.278570 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8fae64ae-6bb7-498a-bbfe-fd5f74b3a259 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.196752 Jul 26 16:33:31.280767 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 98/188] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:31 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:31.361266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fb2a33f9-6e21-46d0-bbf0-3c6dfb5ca12e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:31.371593 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fb2a33f9-6e21-46d0-bbf0-3c6dfb5ca12e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.169708 Jul 26 16:33:31.372165 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 91/189] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:31 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:31.504944 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-461e3f33-203c-47b2-b10c-972be8577939 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:31.506081 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-461e3f33-203c-47b2-b10c-972be8577939 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:31.512332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-461e3f33-203c-47b2-b10c-972be8577939 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:31.512809 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-461e3f33-203c-47b2-b10c-972be8577939 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:31.519615 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-461e3f33-203c-47b2-b10c-972be8577939 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:31.519615 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-461e3f33-203c-47b2-b10c-972be8577939 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:31.667186 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-461e3f33-203c-47b2-b10c-972be8577939 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:31.674649 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-461e3f33-203c-47b2-b10c-972be8577939 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.174422 Jul 26 16:33:31.676430 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 99/190] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:31 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:32.085788 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ba42fc6f-8704-413d-8d58-f19e88c1dc90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:32.086430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ba42fc6f-8704-413d-8d58-f19e88c1dc90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:32.088408 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:32.093248 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ba42fc6f-8704-413d-8d58-f19e88c1dc90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:32.093789 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ba42fc6f-8704-413d-8d58-f19e88c1dc90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:32.094554 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ba42fc6f-8704-413d-8d58-f19e88c1dc90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:32.094993 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ba42fc6f-8704-413d-8d58-f19e88c1dc90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:32.244152 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ba42fc6f-8704-413d-8d58-f19e88c1dc90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:32.256852 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ba42fc6f-8704-413d-8d58-f19e88c1dc90 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.174814 Jul 26 16:33:32.260853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 92/191] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:32 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:32.305258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6ad8c9e4-c6ec-49c6-84fc-bdc3f3160c35 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:32.306107 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6ad8c9e4-c6ec-49c6-84fc-bdc3f3160c35 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:32.322768 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:32.326877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ad8c9e4-c6ec-49c6-84fc-bdc3f3160c35 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:32.330166 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ad8c9e4-c6ec-49c6-84fc-bdc3f3160c35 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:32.331156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ad8c9e4-c6ec-49c6-84fc-bdc3f3160c35 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:32.331605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ad8c9e4-c6ec-49c6-84fc-bdc3f3160c35 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:32.392933 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bd8ead16-f483-4ac4-9a9e-5ac7cddf4982 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:32.397992 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bd8ead16-f483-4ac4-9a9e-5ac7cddf4982 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:32.401646 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd8ead16-f483-4ac4-9a9e-5ac7cddf4982 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:32.402103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd8ead16-f483-4ac4-9a9e-5ac7cddf4982 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:32.402877 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd8ead16-f483-4ac4-9a9e-5ac7cddf4982 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:32.403313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd8ead16-f483-4ac4-9a9e-5ac7cddf4982 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:32.548408 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6ad8c9e4-c6ec-49c6-84fc-bdc3f3160c35 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:32.557213 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6ad8c9e4-c6ec-49c6-84fc-bdc3f3160c35 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.255754 Jul 26 16:33:32.558109 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 100/192] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:32 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:32.594325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bd8ead16-f483-4ac4-9a9e-5ac7cddf4982 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:32.603237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bd8ead16-f483-4ac4-9a9e-5ac7cddf4982 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.214250 Jul 26 16:33:32.603827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 93/193] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:32 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:32.695139 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0b56bb0e-d781-45a2-8c31-b1a079049bed tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:32.695755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0b56bb0e-d781-45a2-8c31-b1a079049bed tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:32.702060 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0b56bb0e-d781-45a2-8c31-b1a079049bed tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:32.702678 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0b56bb0e-d781-45a2-8c31-b1a079049bed tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:32.703446 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0b56bb0e-d781-45a2-8c31-b1a079049bed tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:32.704056 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0b56bb0e-d781-45a2-8c31-b1a079049bed tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:32.873487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0b56bb0e-d781-45a2-8c31-b1a079049bed tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:32.881691 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0b56bb0e-d781-45a2-8c31-b1a079049bed tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.190483 Jul 26 16:33:32.882608 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 101/194] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:32 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:33.277288 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-16f5b8fa-0251-4cd9-9362-5d674629e7ef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:33.277909 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-16f5b8fa-0251-4cd9-9362-5d674629e7ef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:33.284042 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-16f5b8fa-0251-4cd9-9362-5d674629e7ef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:33.284544 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-16f5b8fa-0251-4cd9-9362-5d674629e7ef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:33.285304 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-16f5b8fa-0251-4cd9-9362-5d674629e7ef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:33.285737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-16f5b8fa-0251-4cd9-9362-5d674629e7ef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:33.418720 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-16f5b8fa-0251-4cd9-9362-5d674629e7ef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:33.426553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-16f5b8fa-0251-4cd9-9362-5d674629e7ef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.152522 Jul 26 16:33:33.427109 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 94/195] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:33 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:33.579521 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-37e18d1e-f1ea-4ca2-98fd-69e61edc4ea1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:33.580126 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-37e18d1e-f1ea-4ca2-98fd-69e61edc4ea1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:33.586196 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-37e18d1e-f1ea-4ca2-98fd-69e61edc4ea1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:33.586659 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-37e18d1e-f1ea-4ca2-98fd-69e61edc4ea1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:33.587626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-37e18d1e-f1ea-4ca2-98fd-69e61edc4ea1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:33.588267 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-37e18d1e-f1ea-4ca2-98fd-69e61edc4ea1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:33.624279 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-25a0ef3b-0066-4ec1-b461-1020e950f011 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:33.625038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-25a0ef3b-0066-4ec1-b461-1020e950f011 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:33.632009 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-25a0ef3b-0066-4ec1-b461-1020e950f011 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:33.634474 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-25a0ef3b-0066-4ec1-b461-1020e950f011 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:33.634474 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-25a0ef3b-0066-4ec1-b461-1020e950f011 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:33.634474 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-25a0ef3b-0066-4ec1-b461-1020e950f011 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:33.789471 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-25a0ef3b-0066-4ec1-b461-1020e950f011 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:33.797828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-25a0ef3b-0066-4ec1-b461-1020e950f011 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.177435 Jul 26 16:33:33.812040 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-37e18d1e-f1ea-4ca2-98fd-69e61edc4ea1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:33.812806 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 95/196] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:33 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:33.819071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-37e18d1e-f1ea-4ca2-98fd-69e61edc4ea1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.243414 Jul 26 16:33:33.827779 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 102/197] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:33 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:33.904567 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f9ebdff6-3f7f-4050-b9d2-37749942a452 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:33.905456 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f9ebdff6-3f7f-4050-b9d2-37749942a452 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:33.913987 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9ebdff6-3f7f-4050-b9d2-37749942a452 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:33.918194 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9ebdff6-3f7f-4050-b9d2-37749942a452 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:33.920812 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9ebdff6-3f7f-4050-b9d2-37749942a452 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:33.921688 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9ebdff6-3f7f-4050-b9d2-37749942a452 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:34.074216 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f9ebdff6-3f7f-4050-b9d2-37749942a452 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:34.082175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f9ebdff6-3f7f-4050-b9d2-37749942a452 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.182548 Jul 26 16:33:34.083727 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 96/198] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:33 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:34.447193 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-90d4cfd4-bb06-402b-8e62-3587e5248037 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:34.447823 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-90d4cfd4-bb06-402b-8e62-3587e5248037 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:34.456080 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-90d4cfd4-bb06-402b-8e62-3587e5248037 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:34.456910 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-90d4cfd4-bb06-402b-8e62-3587e5248037 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:34.458746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-90d4cfd4-bb06-402b-8e62-3587e5248037 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:34.459189 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-90d4cfd4-bb06-402b-8e62-3587e5248037 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:34.504815 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-ee1c8190-6ff6-42b5-b463-8d5ed6cc76da req-4384c2a5-e909-4a6f-a16b-d7169c17f2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c1c021-13e8-4f87-bcff-9bac39392b1e", "name": "network-vif-plugged", "status": "completed", "tag": "a5df5a50-4c77-4fe7-abd3-ff061e50b15d"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:34.514761 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-ee1c8190-6ff6-42b5-b463-8d5ed6cc76da req-4384c2a5-e909-4a6f-a16b-d7169c17f2c1 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:34.515458 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-ee1c8190-6ff6-42b5-b463-8d5ed6cc76da req-4384c2a5-e909-4a6f-a16b-d7169c17f2c1 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:34.527199 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-ee1c8190-6ff6-42b5-b463-8d5ed6cc76da req-4384c2a5-e909-4a6f-a16b-d7169c17f2c1 service nova] Creating event network-vif-plugged:a5df5a50-4c77-4fe7-abd3-ff061e50b15d for instance 10c1c021-13e8-4f87-bcff-9bac39392b1e on hv-cinder-85104 Jul 26 16:33:34.532693 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-ee1c8190-6ff6-42b5-b463-8d5ed6cc76da req-4384c2a5-e909-4a6f-a16b-d7169c17f2c1 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092133 Jul 26 16:33:34.533327 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 103/199] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:33:34.605666 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-90d4cfd4-bb06-402b-8e62-3587e5248037 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:34.615116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-90d4cfd4-bb06-402b-8e62-3587e5248037 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.171570 Jul 26 16:33:34.615701 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 97/200] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:34 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:34.820825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-21200630-7795-4616-a6c5-618145c10ba4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:34.830692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-21200630-7795-4616-a6c5-618145c10ba4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:34.834540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-21200630-7795-4616-a6c5-618145c10ba4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:34.835208 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-21200630-7795-4616-a6c5-618145c10ba4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:34.836345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-21200630-7795-4616-a6c5-618145c10ba4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:34.836959 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-21200630-7795-4616-a6c5-618145c10ba4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:34.847419 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8f3bb627-84b4-4b2b-873b-c8f18035f7c9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:34.849088 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8f3bb627-84b4-4b2b-873b-c8f18035f7c9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:34.857138 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8f3bb627-84b4-4b2b-873b-c8f18035f7c9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:34.857902 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8f3bb627-84b4-4b2b-873b-c8f18035f7c9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:34.858951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8f3bb627-84b4-4b2b-873b-c8f18035f7c9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:34.860553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8f3bb627-84b4-4b2b-873b-c8f18035f7c9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:34.885608 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:35.094887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8f3bb627-84b4-4b2b-873b-c8f18035f7c9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:35.107329 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8f3bb627-84b4-4b2b-873b-c8f18035f7c9 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.262417 Jul 26 16:33:35.107329 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 98/201] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:34 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:35.116075 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-af93500e-da3d-4310-8ad4-0330c647c5c7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:35.116075 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-af93500e-da3d-4310-8ad4-0330c647c5c7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:35.128164 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-af93500e-da3d-4310-8ad4-0330c647c5c7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:35.130186 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-af93500e-da3d-4310-8ad4-0330c647c5c7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:35.133176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-af93500e-da3d-4310-8ad4-0330c647c5c7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:35.133628 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-af93500e-da3d-4310-8ad4-0330c647c5c7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:35.157679 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-21200630-7795-4616-a6c5-618145c10ba4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:35.193245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-21200630-7795-4616-a6c5-618145c10ba4 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.351855 Jul 26 16:33:35.196674 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 104/202] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:34 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:35.458306 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-af93500e-da3d-4310-8ad4-0330c647c5c7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:35.466587 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-af93500e-da3d-4310-8ad4-0330c647c5c7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.358470 Jul 26 16:33:35.467177 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 99/203] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:35 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:35.637547 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e2e207ba-c50a-45f9-8080-2d56d1fde268 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:35.638648 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e2e207ba-c50a-45f9-8080-2d56d1fde268 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:35.645417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e2e207ba-c50a-45f9-8080-2d56d1fde268 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:35.645771 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e2e207ba-c50a-45f9-8080-2d56d1fde268 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:35.646706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e2e207ba-c50a-45f9-8080-2d56d1fde268 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:35.647135 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e2e207ba-c50a-45f9-8080-2d56d1fde268 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:35.808933 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e2e207ba-c50a-45f9-8080-2d56d1fde268 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:35.818959 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e2e207ba-c50a-45f9-8080-2d56d1fde268 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.186907 Jul 26 16:33:35.820060 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 105/204] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:35 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:36.128613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8cd14cc9-d1b8-4662-bf98-f982a83034c7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:36.131318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8cd14cc9-d1b8-4662-bf98-f982a83034c7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:36.136875 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8cd14cc9-d1b8-4662-bf98-f982a83034c7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:36.137451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8cd14cc9-d1b8-4662-bf98-f982a83034c7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:36.139131 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8cd14cc9-d1b8-4662-bf98-f982a83034c7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:36.140366 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8cd14cc9-d1b8-4662-bf98-f982a83034c7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:36.223828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e24791ab-e46b-4d2b-8d78-d9cec6ae39ef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:36.224683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e24791ab-e46b-4d2b-8d78-d9cec6ae39ef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:36.231606 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e24791ab-e46b-4d2b-8d78-d9cec6ae39ef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:36.232137 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e24791ab-e46b-4d2b-8d78-d9cec6ae39ef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:36.233046 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e24791ab-e46b-4d2b-8d78-d9cec6ae39ef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:36.233563 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e24791ab-e46b-4d2b-8d78-d9cec6ae39ef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:36.285251 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8cd14cc9-d1b8-4662-bf98-f982a83034c7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:36.294180 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8cd14cc9-d1b8-4662-bf98-f982a83034c7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.171024 Jul 26 16:33:36.309136 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 100/205] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:36 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:36.380377 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e24791ab-e46b-4d2b-8d78-d9cec6ae39ef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:36.387980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e24791ab-e46b-4d2b-8d78-d9cec6ae39ef tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.168905 Jul 26 16:33:36.388579 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 106/206] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:36 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:36.488895 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-db2d1c49-b285-4aef-8fa2-0573b696bbe8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:36.490576 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-db2d1c49-b285-4aef-8fa2-0573b696bbe8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:36.499781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-db2d1c49-b285-4aef-8fa2-0573b696bbe8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:36.500333 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-db2d1c49-b285-4aef-8fa2-0573b696bbe8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:36.501313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-db2d1c49-b285-4aef-8fa2-0573b696bbe8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:36.503673 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-db2d1c49-b285-4aef-8fa2-0573b696bbe8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:36.547150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-3e5af2c4-4270-448a-a51a-17d0304464b1 req-51aefbdc-1c5e-4312-a2ce-77c9c06f243f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee205ae-99c2-4fe2-8160-e336188072b0", "name": "network-vif-plugged", "status": "completed", "tag": "8ff0a433-a61a-4d2f-8754-b2d35e4d59b4"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:36.557153 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-3e5af2c4-4270-448a-a51a-17d0304464b1 req-51aefbdc-1c5e-4312-a2ce-77c9c06f243f service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:36.557595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-3e5af2c4-4270-448a-a51a-17d0304464b1 req-51aefbdc-1c5e-4312-a2ce-77c9c06f243f service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:36.569936 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-3e5af2c4-4270-448a-a51a-17d0304464b1 req-51aefbdc-1c5e-4312-a2ce-77c9c06f243f service nova] Creating event network-vif-plugged:8ff0a433-a61a-4d2f-8754-b2d35e4d59b4 for instance 5ee205ae-99c2-4fe2-8160-e336188072b0 on hv-cinder-85104 Jul 26 16:33:36.575353 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-3e5af2c4-4270-448a-a51a-17d0304464b1 req-51aefbdc-1c5e-4312-a2ce-77c9c06f243f service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031781 Jul 26 16:33:36.576300 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 107/207] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:33:36.644825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-db2d1c49-b285-4aef-8fa2-0573b696bbe8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:36.653293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-db2d1c49-b285-4aef-8fa2-0573b696bbe8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.169595 Jul 26 16:33:36.655136 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 101/208] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:36 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:36.841087 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cd2549a1-e25c-4725-ad4c-56d70b4a4825 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:36.841787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-cd2549a1-e25c-4725-ad4c-56d70b4a4825 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:36.848476 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cd2549a1-e25c-4725-ad4c-56d70b4a4825 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:36.848928 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cd2549a1-e25c-4725-ad4c-56d70b4a4825 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:36.850260 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cd2549a1-e25c-4725-ad4c-56d70b4a4825 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:36.850733 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cd2549a1-e25c-4725-ad4c-56d70b4a4825 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:36.855162 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:37.005912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-cd2549a1-e25c-4725-ad4c-56d70b4a4825 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:37.013523 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-cd2549a1-e25c-4725-ad4c-56d70b4a4825 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.176742 Jul 26 16:33:37.014090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 108/209] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:36 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:37.314977 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-724bb19f-d2f4-4d14-8407-cbb4531988b7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:37.315576 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-724bb19f-d2f4-4d14-8407-cbb4531988b7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:37.321858 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-724bb19f-d2f4-4d14-8407-cbb4531988b7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:37.322304 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-724bb19f-d2f4-4d14-8407-cbb4531988b7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:37.323087 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-724bb19f-d2f4-4d14-8407-cbb4531988b7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:37.323498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-724bb19f-d2f4-4d14-8407-cbb4531988b7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:37.409082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b93501bf-6a7a-478d-bbf7-02d20ba21ffb tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:37.409878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b93501bf-6a7a-478d-bbf7-02d20ba21ffb tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:37.417469 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b93501bf-6a7a-478d-bbf7-02d20ba21ffb tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:37.417920 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b93501bf-6a7a-478d-bbf7-02d20ba21ffb tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:37.418804 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b93501bf-6a7a-478d-bbf7-02d20ba21ffb tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:37.419303 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b93501bf-6a7a-478d-bbf7-02d20ba21ffb tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:37.534524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-724bb19f-d2f4-4d14-8407-cbb4531988b7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:37.543310 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-724bb19f-d2f4-4d14-8407-cbb4531988b7 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.232092 Jul 26 16:33:37.544556 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 102/210] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:37 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:37.591348 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b93501bf-6a7a-478d-bbf7-02d20ba21ffb tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:37.599401 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b93501bf-6a7a-478d-bbf7-02d20ba21ffb tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.194543 Jul 26 16:33:37.599970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 109/211] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:37 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:37.675625 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7f412d88-3be7-4155-bbfb-11e66c361e8a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:37.677571 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7f412d88-3be7-4155-bbfb-11e66c361e8a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:37.683540 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f412d88-3be7-4155-bbfb-11e66c361e8a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:37.683540 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f412d88-3be7-4155-bbfb-11e66c361e8a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:37.684260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f412d88-3be7-4155-bbfb-11e66c361e8a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:37.684889 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f412d88-3be7-4155-bbfb-11e66c361e8a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:37.823039 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7f412d88-3be7-4155-bbfb-11e66c361e8a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:37.830705 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7f412d88-3be7-4155-bbfb-11e66c361e8a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.159195 Jul 26 16:33:37.831262 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 103/212] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:37 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:38.034827 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-320e3c1c-544d-4ea6-807c-78ed9798cdbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:38.036022 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-320e3c1c-544d-4ea6-807c-78ed9798cdbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:38.042272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-320e3c1c-544d-4ea6-807c-78ed9798cdbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:38.042713 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-320e3c1c-544d-4ea6-807c-78ed9798cdbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:38.043466 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-320e3c1c-544d-4ea6-807c-78ed9798cdbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:38.043924 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-320e3c1c-544d-4ea6-807c-78ed9798cdbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:38.184551 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-320e3c1c-544d-4ea6-807c-78ed9798cdbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:38.194251 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-320e3c1c-544d-4ea6-807c-78ed9798cdbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.163268 Jul 26 16:33:38.194821 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 110/213] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:38 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:38.568917 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1076eb0a-9df0-4150-9cff-3295ff797b14 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:38.569526 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1076eb0a-9df0-4150-9cff-3295ff797b14 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:38.572496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:38.576361 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1076eb0a-9df0-4150-9cff-3295ff797b14 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:38.576820 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1076eb0a-9df0-4150-9cff-3295ff797b14 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:38.577588 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1076eb0a-9df0-4150-9cff-3295ff797b14 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:38.578019 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1076eb0a-9df0-4150-9cff-3295ff797b14 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:38.593547 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-9df05f77-ff35-4143-9080-00b1421543c9 req-6763ccb0-dcb8-4be6-8384-c9e49a0d97fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4", "name": "network-vif-plugged", "status": "completed", "tag": "26e755d4-3673-4a1f-82d7-5cb16e9faf7f"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:38.622261 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-9df05f77-ff35-4143-9080-00b1421543c9 req-6763ccb0-dcb8-4be6-8384-c9e49a0d97fb service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:38.622261 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-9df05f77-ff35-4143-9080-00b1421543c9 req-6763ccb0-dcb8-4be6-8384-c9e49a0d97fb service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:38.631536 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-9df05f77-ff35-4143-9080-00b1421543c9 req-6763ccb0-dcb8-4be6-8384-c9e49a0d97fb service nova] Creating event network-vif-plugged:26e755d4-3673-4a1f-82d7-5cb16e9faf7f for instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 on hv-cinder-85104 Jul 26 16:33:38.636616 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-9df05f77-ff35-4143-9080-00b1421543c9 req-6763ccb0-dcb8-4be6-8384-c9e49a0d97fb service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049143 Jul 26 16:33:38.637208 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 111/214] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:33:38.643752 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6b65d83a-20b4-441e-b4c1-a57e0e3aa06b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:38.645054 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6b65d83a-20b4-441e-b4c1-a57e0e3aa06b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:38.651862 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6b65d83a-20b4-441e-b4c1-a57e0e3aa06b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:38.652308 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6b65d83a-20b4-441e-b4c1-a57e0e3aa06b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:38.653159 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6b65d83a-20b4-441e-b4c1-a57e0e3aa06b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:38.653774 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6b65d83a-20b4-441e-b4c1-a57e0e3aa06b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:38.720289 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1076eb0a-9df0-4150-9cff-3295ff797b14 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:38.729292 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1076eb0a-9df0-4150-9cff-3295ff797b14 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.164063 Jul 26 16:33:38.731430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 104/215] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:38 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:38.811957 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6b65d83a-20b4-441e-b4c1-a57e0e3aa06b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:38.820335 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6b65d83a-20b4-441e-b4c1-a57e0e3aa06b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.181703 Jul 26 16:33:38.820938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 112/216] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:38 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:38.854145 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c98369ef-98e4-48aa-b04b-e172cd6ebbcf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:38.854767 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c98369ef-98e4-48aa-b04b-e172cd6ebbcf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:38.862401 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c98369ef-98e4-48aa-b04b-e172cd6ebbcf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:38.863226 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c98369ef-98e4-48aa-b04b-e172cd6ebbcf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:38.864663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c98369ef-98e4-48aa-b04b-e172cd6ebbcf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:38.865314 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c98369ef-98e4-48aa-b04b-e172cd6ebbcf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:39.041321 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c98369ef-98e4-48aa-b04b-e172cd6ebbcf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:39.052596 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c98369ef-98e4-48aa-b04b-e172cd6ebbcf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.202856 Jul 26 16:33:39.054118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 105/217] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:38 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:39.215077 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-bd8c8752-7515-45d3-acda-7d39f1f17e0d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:39.216720 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-bd8c8752-7515-45d3-acda-7d39f1f17e0d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:39.224522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd8c8752-7515-45d3-acda-7d39f1f17e0d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:39.224788 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd8c8752-7515-45d3-acda-7d39f1f17e0d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:39.229969 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd8c8752-7515-45d3-acda-7d39f1f17e0d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:39.229969 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd8c8752-7515-45d3-acda-7d39f1f17e0d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:39.407776 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-bd8c8752-7515-45d3-acda-7d39f1f17e0d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:39.419302 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-bd8c8752-7515-45d3-acda-7d39f1f17e0d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.207787 Jul 26 16:33:39.419750 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 113/218] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:39 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:39.750027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a58b2896-5694-4607-bbde-d9b3e9064b6e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:39.750742 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a58b2896-5694-4607-bbde-d9b3e9064b6e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:39.756822 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a58b2896-5694-4607-bbde-d9b3e9064b6e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:39.757264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a58b2896-5694-4607-bbde-d9b3e9064b6e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:39.758161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a58b2896-5694-4607-bbde-d9b3e9064b6e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:39.758595 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a58b2896-5694-4607-bbde-d9b3e9064b6e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:39.841543 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d5306908-d79e-45af-bc72-c93cf42e66cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:39.841894 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d5306908-d79e-45af-bc72-c93cf42e66cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:39.851850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d5306908-d79e-45af-bc72-c93cf42e66cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:39.852293 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d5306908-d79e-45af-bc72-c93cf42e66cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:39.860625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d5306908-d79e-45af-bc72-c93cf42e66cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:39.861868 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d5306908-d79e-45af-bc72-c93cf42e66cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:40.069373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d5306908-d79e-45af-bc72-c93cf42e66cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:40.080913 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d5306908-d79e-45af-bc72-c93cf42e66cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.240437 Jul 26 16:33:40.080913 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 114/219] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:39 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:40.083082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-58b311e2-ae17-4130-a1a9-d3108514366d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:40.083684 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-58b311e2-ae17-4130-a1a9-d3108514366d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:40.090049 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-58b311e2-ae17-4130-a1a9-d3108514366d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:40.090409 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-58b311e2-ae17-4130-a1a9-d3108514366d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:40.091175 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-58b311e2-ae17-4130-a1a9-d3108514366d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:40.091599 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-58b311e2-ae17-4130-a1a9-d3108514366d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:40.183340 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a58b2896-5694-4607-bbde-d9b3e9064b6e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:40.192674 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a58b2896-5694-4607-bbde-d9b3e9064b6e tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.446181 Jul 26 16:33:40.192674 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 106/220] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:39 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:40.280365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-58b311e2-ae17-4130-a1a9-d3108514366d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:40.288797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-58b311e2-ae17-4130-a1a9-d3108514366d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.209512 Jul 26 16:33:40.289517 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 115/221] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:40 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:40.443492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8e392fa5-84b2-4416-9197-764eecdcc768 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:40.447512 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8e392fa5-84b2-4416-9197-764eecdcc768 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:40.462413 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e392fa5-84b2-4416-9197-764eecdcc768 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:40.463207 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e392fa5-84b2-4416-9197-764eecdcc768 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:40.481463 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e392fa5-84b2-4416-9197-764eecdcc768 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:40.484091 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e392fa5-84b2-4416-9197-764eecdcc768 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:40.800348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8e392fa5-84b2-4416-9197-764eecdcc768 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:40.810853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8e392fa5-84b2-4416-9197-764eecdcc768 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.373773 Jul 26 16:33:40.812209 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 107/222] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:40 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:41.099121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7cf6de8a-a2d7-4afa-b3f5-3792e75d5e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:41.099724 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7cf6de8a-a2d7-4afa-b3f5-3792e75d5e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:41.105880 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cf6de8a-a2d7-4afa-b3f5-3792e75d5e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:41.106325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cf6de8a-a2d7-4afa-b3f5-3792e75d5e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:41.107073 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cf6de8a-a2d7-4afa-b3f5-3792e75d5e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:41.107504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cf6de8a-a2d7-4afa-b3f5-3792e75d5e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:41.212828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2b292772-07c0-4b35-93d8-a4ee01f7e113 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:41.213515 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2b292772-07c0-4b35-93d8-a4ee01f7e113 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:41.219607 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2b292772-07c0-4b35-93d8-a4ee01f7e113 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:41.220058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2b292772-07c0-4b35-93d8-a4ee01f7e113 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:41.220842 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2b292772-07c0-4b35-93d8-a4ee01f7e113 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:41.221274 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2b292772-07c0-4b35-93d8-a4ee01f7e113 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:41.256904 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7cf6de8a-a2d7-4afa-b3f5-3792e75d5e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:41.264411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7cf6de8a-a2d7-4afa-b3f5-3792e75d5e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.169632 Jul 26 16:33:41.265521 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 116/223] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:41 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:41.316640 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1ad1ba7a-d473-4110-a93d-ec6f1910aaae tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:41.317342 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1ad1ba7a-d473-4110-a93d-ec6f1910aaae tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:41.323892 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1ad1ba7a-d473-4110-a93d-ec6f1910aaae tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:41.324822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1ad1ba7a-d473-4110-a93d-ec6f1910aaae tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:41.325746 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1ad1ba7a-d473-4110-a93d-ec6f1910aaae tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:41.326370 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1ad1ba7a-d473-4110-a93d-ec6f1910aaae tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:41.419191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2b292772-07c0-4b35-93d8-a4ee01f7e113 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:41.434550 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2b292772-07c0-4b35-93d8-a4ee01f7e113 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.222404 Jul 26 16:33:41.435193 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 108/224] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:41 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:41.538965 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1ad1ba7a-d473-4110-a93d-ec6f1910aaae tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:41.553475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1ad1ba7a-d473-4110-a93d-ec6f1910aaae tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.244288 Jul 26 16:33:41.565101 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 117/225] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:41 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:41.833885 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e287f4b9-38ff-42f6-9c1b-0f73abb694ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:41.834575 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e287f4b9-38ff-42f6-9c1b-0f73abb694ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:41.840730 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e287f4b9-38ff-42f6-9c1b-0f73abb694ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:41.841496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e287f4b9-38ff-42f6-9c1b-0f73abb694ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:41.842522 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e287f4b9-38ff-42f6-9c1b-0f73abb694ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:41.843153 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e287f4b9-38ff-42f6-9c1b-0f73abb694ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:41.999463 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e287f4b9-38ff-42f6-9c1b-0f73abb694ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:42.014581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e287f4b9-38ff-42f6-9c1b-0f73abb694ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.185296 Jul 26 16:33:42.015671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 109/226] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:41 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:42.286021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4a31a378-1079-4624-92c0-567ee54534d3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:42.287282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4a31a378-1079-4624-92c0-567ee54534d3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:42.299854 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-e679eb5b-e9f3-4dee-8c08-215223bc6b6e req-62f017ad-055f-46c6-ad45-eea4e13b9bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a999303-ed3e-4e86-b4f3-4d04e1aec162", "name": "network-vif-plugged", "status": "completed", "tag": "bf8c65dd-f0b9-4fd7-9a7b-bffc6f90dd01"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:42.308625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4a31a378-1079-4624-92c0-567ee54534d3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:42.308625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4a31a378-1079-4624-92c0-567ee54534d3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:42.308625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4a31a378-1079-4624-92c0-567ee54534d3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:42.308859 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4a31a378-1079-4624-92c0-567ee54534d3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:42.315880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-e679eb5b-e9f3-4dee-8c08-215223bc6b6e req-62f017ad-055f-46c6-ad45-eea4e13b9bae service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:42.316320 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-e679eb5b-e9f3-4dee-8c08-215223bc6b6e req-62f017ad-055f-46c6-ad45-eea4e13b9bae service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:42.333611 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-e679eb5b-e9f3-4dee-8c08-215223bc6b6e req-62f017ad-055f-46c6-ad45-eea4e13b9bae service nova] Creating event network-vif-plugged:bf8c65dd-f0b9-4fd7-9a7b-bffc6f90dd01 for instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 on hv-cinder-85104 Jul 26 16:33:42.338929 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-e679eb5b-e9f3-4dee-8c08-215223bc6b6e req-62f017ad-055f-46c6-ad45-eea4e13b9bae service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043446 Jul 26 16:33:42.339576 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 110/227] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:33:42.465568 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2c1b6d40-fc71-4066-b75a-2433c227521c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:42.466845 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2c1b6d40-fc71-4066-b75a-2433c227521c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:42.474293 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4a31a378-1079-4624-92c0-567ee54534d3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:42.478643 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4a31a378-1079-4624-92c0-567ee54534d3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.197105 Jul 26 16:33:42.479440 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 118/228] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:42 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:42.482225 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2c1b6d40-fc71-4066-b75a-2433c227521c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:42.482867 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2c1b6d40-fc71-4066-b75a-2433c227521c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:42.483806 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2c1b6d40-fc71-4066-b75a-2433c227521c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:42.484252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2c1b6d40-fc71-4066-b75a-2433c227521c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:42.576233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f289a85d-731d-444d-9114-5bef778d3cfd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:42.576876 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f289a85d-731d-444d-9114-5bef778d3cfd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:42.584492 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f289a85d-731d-444d-9114-5bef778d3cfd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:42.584947 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f289a85d-731d-444d-9114-5bef778d3cfd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:42.585721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f289a85d-731d-444d-9114-5bef778d3cfd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:42.596044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f289a85d-731d-444d-9114-5bef778d3cfd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:42.699078 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2c1b6d40-fc71-4066-b75a-2433c227521c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:42.706919 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2c1b6d40-fc71-4066-b75a-2433c227521c tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.251841 Jul 26 16:33:42.708094 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 111/229] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:42 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:43.018835 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f289a85d-731d-444d-9114-5bef778d3cfd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:43.026867 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f289a85d-731d-444d-9114-5bef778d3cfd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.454430 Jul 26 16:33:43.027433 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 119/230] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:42 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:43.034898 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-20336a34-2584-4555-b4d4-febc3c161197 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:43.036085 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-20336a34-2584-4555-b4d4-febc3c161197 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:43.042346 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20336a34-2584-4555-b4d4-febc3c161197 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:43.042787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20336a34-2584-4555-b4d4-febc3c161197 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:43.043564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20336a34-2584-4555-b4d4-febc3c161197 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:43.043979 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20336a34-2584-4555-b4d4-febc3c161197 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:43.179365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-20336a34-2584-4555-b4d4-febc3c161197 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:43.189022 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-20336a34-2584-4555-b4d4-febc3c161197 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.157851 Jul 26 16:33:43.189782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 112/231] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:43 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:43.499064 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2d58a314-fb36-4fca-b2d5-eec129893010 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:43.499665 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2d58a314-fb36-4fca-b2d5-eec129893010 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:43.506136 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d58a314-fb36-4fca-b2d5-eec129893010 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:43.506847 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d58a314-fb36-4fca-b2d5-eec129893010 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:43.507802 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d58a314-fb36-4fca-b2d5-eec129893010 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:43.508452 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d58a314-fb36-4fca-b2d5-eec129893010 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:43.645394 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2d58a314-fb36-4fca-b2d5-eec129893010 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:43.653912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2d58a314-fb36-4fca-b2d5-eec129893010 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1371 microversion: 2.1 time: 0.158565 Jul 26 16:33:43.654995 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 120/232] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:43 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:43.734156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-58ba438e-368c-43ae-825b-5e766e7993f4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:43.735170 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-58ba438e-368c-43ae-825b-5e766e7993f4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:43.743328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58ba438e-368c-43ae-825b-5e766e7993f4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:43.743940 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58ba438e-368c-43ae-825b-5e766e7993f4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:43.745343 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58ba438e-368c-43ae-825b-5e766e7993f4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:43.746109 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58ba438e-368c-43ae-825b-5e766e7993f4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:43.900886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-58ba438e-368c-43ae-825b-5e766e7993f4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:43.908934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-58ba438e-368c-43ae-825b-5e766e7993f4 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.181035 Jul 26 16:33:43.909422 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 113/233] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:43 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:44.049437 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5d200d88-d6f3-42ec-9b7d-63476da86446 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:44.050051 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5d200d88-d6f3-42ec-9b7d-63476da86446 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:44.068498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d200d88-d6f3-42ec-9b7d-63476da86446 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.068498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d200d88-d6f3-42ec-9b7d-63476da86446 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:44.068498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d200d88-d6f3-42ec-9b7d-63476da86446 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.068498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d200d88-d6f3-42ec-9b7d-63476da86446 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:44.214539 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5d200d88-d6f3-42ec-9b7d-63476da86446 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:44.215073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e0c65d96-591a-49d8-afe1-8f57e2c6b20e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:44.215706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e0c65d96-591a-49d8-afe1-8f57e2c6b20e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:44.224981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5d200d88-d6f3-42ec-9b7d-63476da86446 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.177437 Jul 26 16:33:44.225592 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 121/234] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:44 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:44.233870 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e0c65d96-591a-49d8-afe1-8f57e2c6b20e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.235946 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e0c65d96-591a-49d8-afe1-8f57e2c6b20e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:44.240027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e0c65d96-591a-49d8-afe1-8f57e2c6b20e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.240938 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e0c65d96-591a-49d8-afe1-8f57e2c6b20e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:44.369807 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-6a257eef-bf9f-4b32-aa20-872d737992fd req-ae805059-2bd9-47ee-863d-9198662acb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad766a1-6214-4f3a-aa55-50ca2baa6b64", "name": "network-vif-plugged", "status": "completed", "tag": "16990b57-d241-4bda-9263-5fdbfd1138b4"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:44.395470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e0c65d96-591a-49d8-afe1-8f57e2c6b20e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:44.397636 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-6a257eef-bf9f-4b32-aa20-872d737992fd req-ae805059-2bd9-47ee-863d-9198662acb93 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.398152 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-6a257eef-bf9f-4b32-aa20-872d737992fd req-ae805059-2bd9-47ee-863d-9198662acb93 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:44.413352 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e0c65d96-591a-49d8-afe1-8f57e2c6b20e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1325 microversion: 2.1 time: 0.206860 Jul 26 16:33:44.413876 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 114/235] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:44 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1325 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:44.436236 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-6a257eef-bf9f-4b32-aa20-872d737992fd req-ae805059-2bd9-47ee-863d-9198662acb93 service nova] Creating event network-vif-plugged:16990b57-d241-4bda-9263-5fdbfd1138b4 for instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 on hv-cinder-85104 Jul 26 16:33:44.442696 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-6a257eef-bf9f-4b32-aa20-872d737992fd req-ae805059-2bd9-47ee-863d-9198662acb93 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076682 Jul 26 16:33:44.443463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 122/236] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:33:44.675458 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4171bb05-dfe8-4785-952a-5aadeb3e73e3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:44.676920 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4171bb05-dfe8-4785-952a-5aadeb3e73e3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:44.683175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4171bb05-dfe8-4785-952a-5aadeb3e73e3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.683623 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4171bb05-dfe8-4785-952a-5aadeb3e73e3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:44.684425 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4171bb05-dfe8-4785-952a-5aadeb3e73e3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.685111 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4171bb05-dfe8-4785-952a-5aadeb3e73e3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:44.869651 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4171bb05-dfe8-4785-952a-5aadeb3e73e3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:44.873255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:44.877704 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4171bb05-dfe8-4785-952a-5aadeb3e73e3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1561 microversion: 2.1 time: 0.206451 Jul 26 16:33:44.878207 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 115/237] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:44 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1561 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:44.900205 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-845e3cf8-0b96-4622-8933-e2904346dc48 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:44.900792 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-845e3cf8-0b96-4622-8933-e2904346dc48 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:44.907016 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-845e3cf8-0b96-4622-8933-e2904346dc48 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.907486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-845e3cf8-0b96-4622-8933-e2904346dc48 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:44.908234 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-845e3cf8-0b96-4622-8933-e2904346dc48 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.908739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-845e3cf8-0b96-4622-8933-e2904346dc48 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:44.929565 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ccde1f4c-137e-41e5-8b3e-ac1f19f52afa tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:44.930251 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ccde1f4c-137e-41e5-8b3e-ac1f19f52afa tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:44.936668 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ccde1f4c-137e-41e5-8b3e-ac1f19f52afa tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.937177 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ccde1f4c-137e-41e5-8b3e-ac1f19f52afa tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:44.938114 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ccde1f4c-137e-41e5-8b3e-ac1f19f52afa tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:44.938555 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ccde1f4c-137e-41e5-8b3e-ac1f19f52afa tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:45.032972 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-845e3cf8-0b96-4622-8933-e2904346dc48 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136504 Jul 26 16:33:45.034219 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 123/238] 10.222.0.144 () {58 vars in 1280 bytes} [Tue Jul 26 16:33:44 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:33:45.246164 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ccde1f4c-137e-41e5-8b3e-ac1f19f52afa tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:45.249313 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8d5748f7-686e-4d11-ad7e-db22dd2a1a16 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:45.250098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8d5748f7-686e-4d11-ad7e-db22dd2a1a16 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:45.261779 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d5748f7-686e-4d11-ad7e-db22dd2a1a16 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:45.262229 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d5748f7-686e-4d11-ad7e-db22dd2a1a16 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:45.263016 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d5748f7-686e-4d11-ad7e-db22dd2a1a16 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:45.263442 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d5748f7-686e-4d11-ad7e-db22dd2a1a16 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:45.268558 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ccde1f4c-137e-41e5-8b3e-ac1f19f52afa tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1319 microversion: 2.1 time: 0.334959 Jul 26 16:33:45.269280 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 116/239] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:44 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:45.403229 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8d5748f7-686e-4d11-ad7e-db22dd2a1a16 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:45.411993 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8d5748f7-686e-4d11-ad7e-db22dd2a1a16 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.170048 Jul 26 16:33:45.413184 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 124/240] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:45 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:33:45.434023 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5efba2a7-0449-4c01-bca0-a48ffa97e5b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:45.434629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5efba2a7-0449-4c01-bca0-a48ffa97e5b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:45.440605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5efba2a7-0449-4c01-bca0-a48ffa97e5b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:45.441046 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5efba2a7-0449-4c01-bca0-a48ffa97e5b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:45.442500 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5efba2a7-0449-4c01-bca0-a48ffa97e5b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:45.442931 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5efba2a7-0449-4c01-bca0-a48ffa97e5b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:45.809987 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5efba2a7-0449-4c01-bca0-a48ffa97e5b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:45.818030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5efba2a7-0449-4c01-bca0-a48ffa97e5b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1518 microversion: 2.1 time: 0.387824 Jul 26 16:33:45.818805 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 117/241] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:45 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1518 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:45.839553 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-594bf605-1c46-41c5-8826-b3d55d12f610 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:45.841890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-594bf605-1c46-41c5-8826-b3d55d12f610 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:45.848019 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-594bf605-1c46-41c5-8826-b3d55d12f610 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:45.848590 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-594bf605-1c46-41c5-8826-b3d55d12f610 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:45.849440 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-594bf605-1c46-41c5-8826-b3d55d12f610 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:45.849943 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-594bf605-1c46-41c5-8826-b3d55d12f610 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:45.873876 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-594bf605-1c46-41c5-8826-b3d55d12f610 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lazy-loading 'flavor' on Instance uuid 5ee205ae-99c2-4fe2-8160-e336188072b0 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:33:45.938164 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:33:46.290242 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9467bd73-9f70-4e9b-bacf-79c34812ff62 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:46.290811 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9467bd73-9f70-4e9b-bacf-79c34812ff62 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:46.297568 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9467bd73-9f70-4e9b-bacf-79c34812ff62 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:46.298012 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9467bd73-9f70-4e9b-bacf-79c34812ff62 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:46.298768 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9467bd73-9f70-4e9b-bacf-79c34812ff62 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:46.299199 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9467bd73-9f70-4e9b-bacf-79c34812ff62 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:46.513399 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9467bd73-9f70-4e9b-bacf-79c34812ff62 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:46.524842 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9467bd73-9f70-4e9b-bacf-79c34812ff62 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1506 microversion: 2.1 time: 0.238495 Jul 26 16:33:46.525662 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 118/242] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:46 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:46.540343 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-32752f54-3b1e-4cd4-9943-f5f2974518a8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:46.540343 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-32752f54-3b1e-4cd4-9943-f5f2974518a8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:46.545987 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32752f54-3b1e-4cd4-9943-f5f2974518a8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:46.546410 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32752f54-3b1e-4cd4-9943-f5f2974518a8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:46.547176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32752f54-3b1e-4cd4-9943-f5f2974518a8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:46.547596 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32752f54-3b1e-4cd4-9943-f5f2974518a8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:46.570502 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-594bf605-1c46-41c5-8826-b3d55d12f610 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0/action" status: 200 len: 32 microversion: 2.1 time: 0.734930 Jul 26 16:33:46.571108 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 125/243] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:33:45 2022] POST /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0/action => generated 32 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 16:33:46.585056 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1d705a93-4684-4ac0-8f92-f273a4a17aa3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:46.585768 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1d705a93-4684-4ac0-8f92-f273a4a17aa3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:46.592883 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d705a93-4684-4ac0-8f92-f273a4a17aa3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:46.593370 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d705a93-4684-4ac0-8f92-f273a4a17aa3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:46.594336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d705a93-4684-4ac0-8f92-f273a4a17aa3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:46.595016 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d705a93-4684-4ac0-8f92-f273a4a17aa3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:46.747901 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1d705a93-4684-4ac0-8f92-f273a4a17aa3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:46.768527 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1d705a93-4684-4ac0-8f92-f273a4a17aa3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.178686 Jul 26 16:33:46.768527 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 126/244] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:46 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:46.788161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-32752f54-3b1e-4cd4-9943-f5f2974518a8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:46.804757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-32752f54-3b1e-4cd4-9943-f5f2974518a8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.276979 Jul 26 16:33:46.975485 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 119/245] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:46 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:46.977278 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-c09e7df1-47ed-4d76-8db8-741499c6af04 req-3bd60e9f-d2d0-4f46-8529-3edb35b23895 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10c1c021-13e8-4f87-bcff-9bac39392b1e", "tag": "a5df5a50-4c77-4fe7-abd3-ff061e50b15d"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:46.977278 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-c09e7df1-47ed-4d76-8db8-741499c6af04 req-3bd60e9f-d2d0-4f46-8529-3edb35b23895 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:46.977278 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-c09e7df1-47ed-4d76-8db8-741499c6af04 req-3bd60e9f-d2d0-4f46-8529-3edb35b23895 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:46.977278 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-c09e7df1-47ed-4d76-8db8-741499c6af04 req-3bd60e9f-d2d0-4f46-8529-3edb35b23895 service nova] Creating event network-changed:a5df5a50-4c77-4fe7-abd3-ff061e50b15d for instance 10c1c021-13e8-4f87-bcff-9bac39392b1e on hv-cinder-85104 Jul 26 16:33:46.978434 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-c09e7df1-47ed-4d76-8db8-741499c6af04 req-3bd60e9f-d2d0-4f46-8529-3edb35b23895 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029835 Jul 26 16:33:46.978434 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 127/246] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:33:47.778120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e9a70c3d-1bd8-4d4d-bb35-eb03db0fc929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:47.778737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e9a70c3d-1bd8-4d4d-bb35-eb03db0fc929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:47.785738 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e9a70c3d-1bd8-4d4d-bb35-eb03db0fc929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:47.786263 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e9a70c3d-1bd8-4d4d-bb35-eb03db0fc929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:47.787040 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e9a70c3d-1bd8-4d4d-bb35-eb03db0fc929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:47.787475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e9a70c3d-1bd8-4d4d-bb35-eb03db0fc929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:47.930884 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e9a70c3d-1bd8-4d4d-bb35-eb03db0fc929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:47.939455 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e9a70c3d-1bd8-4d4d-bb35-eb03db0fc929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.165149 Jul 26 16:33:47.945355 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 120/247] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:47 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:47.982965 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6a4b0dfa-1d59-4fc1-9689-b53ee83dcbac tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:47.983676 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6a4b0dfa-1d59-4fc1-9689-b53ee83dcbac tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:48.020898 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6a4b0dfa-1d59-4fc1-9689-b53ee83dcbac tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:48.020898 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6a4b0dfa-1d59-4fc1-9689-b53ee83dcbac tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:48.020898 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6a4b0dfa-1d59-4fc1-9689-b53ee83dcbac tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:48.020898 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6a4b0dfa-1d59-4fc1-9689-b53ee83dcbac tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:48.129468 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6a4b0dfa-1d59-4fc1-9689-b53ee83dcbac tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:48.137206 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6a4b0dfa-1d59-4fc1-9689-b53ee83dcbac tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1366 microversion: 2.1 time: 0.158386 Jul 26 16:33:48.138021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 128/248] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:47 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:48.979782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d8e09aa9-2900-415f-8977-1e02ec5c43e4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:48.979782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d8e09aa9-2900-415f-8977-1e02ec5c43e4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:48.979782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d8e09aa9-2900-415f-8977-1e02ec5c43e4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:48.979782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d8e09aa9-2900-415f-8977-1e02ec5c43e4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:48.980667 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d8e09aa9-2900-415f-8977-1e02ec5c43e4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:48.980667 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d8e09aa9-2900-415f-8977-1e02ec5c43e4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:49.102274 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d8e09aa9-2900-415f-8977-1e02ec5c43e4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:49.110712 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d8e09aa9-2900-415f-8977-1e02ec5c43e4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.154725 Jul 26 16:33:49.111408 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 121/249] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:48 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:49.159171 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1486d2b1-b9fd-4d1b-9497-d0989d26c343 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:49.159625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1486d2b1-b9fd-4d1b-9497-d0989d26c343 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:49.167030 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1486d2b1-b9fd-4d1b-9497-d0989d26c343 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:49.167482 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1486d2b1-b9fd-4d1b-9497-d0989d26c343 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:49.168473 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1486d2b1-b9fd-4d1b-9497-d0989d26c343 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:49.168926 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1486d2b1-b9fd-4d1b-9497-d0989d26c343 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:49.411745 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1486d2b1-b9fd-4d1b-9497-d0989d26c343 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:49.419848 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1486d2b1-b9fd-4d1b-9497-d0989d26c343 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1551 microversion: 2.1 time: 0.264890 Jul 26 16:33:49.432071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 129/250] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:49 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1551 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:49.447280 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fbdb13f0-da87-4c77-9330-7ae476609fe7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:49.448328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fbdb13f0-da87-4c77-9330-7ae476609fe7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:49.459044 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fbdb13f0-da87-4c77-9330-7ae476609fe7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:49.459540 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fbdb13f0-da87-4c77-9330-7ae476609fe7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:49.460339 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fbdb13f0-da87-4c77-9330-7ae476609fe7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:49.460823 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fbdb13f0-da87-4c77-9330-7ae476609fe7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:49.598181 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fbdb13f0-da87-4c77-9330-7ae476609fe7 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159743 Jul 26 16:33:49.598866 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 122/251] 10.222.0.144 () {58 vars in 1280 bytes} [Tue Jul 26 16:33:49 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:33:50.131538 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-858dcf39-1100-424e-9140-7998d25273db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:50.133176 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-858dcf39-1100-424e-9140-7998d25273db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:50.139815 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-858dcf39-1100-424e-9140-7998d25273db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:50.140246 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-858dcf39-1100-424e-9140-7998d25273db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:50.141309 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-858dcf39-1100-424e-9140-7998d25273db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:50.141936 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-858dcf39-1100-424e-9140-7998d25273db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:50.384071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-858dcf39-1100-424e-9140-7998d25273db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:50.392756 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-858dcf39-1100-424e-9140-7998d25273db tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.265226 Jul 26 16:33:50.393459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 130/252] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:50 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:50.816250 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8833cfdb-96d6-44ef-bff5-f96569947774 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4187e04d-ee92-4814-b8dc-5d985b424acc"}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:50.819659 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8833cfdb-96d6-44ef-bff5-f96569947774 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:50.826550 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8833cfdb-96d6-44ef-bff5-f96569947774 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:50.827325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8833cfdb-96d6-44ef-bff5-f96569947774 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:50.828279 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8833cfdb-96d6-44ef-bff5-f96569947774 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:50.828758 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8833cfdb-96d6-44ef-bff5-f96569947774 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:51.294721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-5d6e9f73-2141-494d-815e-c1e2108012a1 req-db058b73-0d41-4e1c-9329-055d9e2c6796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a999303-ed3e-4e86-b4f3-4d04e1aec162", "tag": "bf8c65dd-f0b9-4fd7-9a7b-bffc6f90dd01"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:33:51.308863 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-5d6e9f73-2141-494d-815e-c1e2108012a1 req-db058b73-0d41-4e1c-9329-055d9e2c6796 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:51.309309 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-5d6e9f73-2141-494d-815e-c1e2108012a1 req-db058b73-0d41-4e1c-9329-055d9e2c6796 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:51.331841 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-5d6e9f73-2141-494d-815e-c1e2108012a1 req-db058b73-0d41-4e1c-9329-055d9e2c6796 service nova] Creating event network-changed:bf8c65dd-f0b9-4fd7-9a7b-bffc6f90dd01 for instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 on hv-cinder-85104 Jul 26 16:33:51.341519 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-5d6e9f73-2141-494d-815e-c1e2108012a1 req-db058b73-0d41-4e1c-9329-055d9e2c6796 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050202 Jul 26 16:33:51.342215 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 131/253] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:33:51.416634 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e934b56f-396f-42e2-9947-78fe76e2d6c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:51.417717 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e934b56f-396f-42e2-9947-78fe76e2d6c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:51.428631 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e934b56f-396f-42e2-9947-78fe76e2d6c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:51.431120 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e934b56f-396f-42e2-9947-78fe76e2d6c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:51.433887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e934b56f-396f-42e2-9947-78fe76e2d6c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:51.434447 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e934b56f-396f-42e2-9947-78fe76e2d6c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:51.667335 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e934b56f-396f-42e2-9947-78fe76e2d6c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:51.674982 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e934b56f-396f-42e2-9947-78fe76e2d6c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.263668 Jul 26 16:33:51.675945 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 132/254] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:51 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:52.597118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8833cfdb-96d6-44ef-bff5-f96569947774 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "POST /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.784645 Jul 26 16:33:52.598097 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 123/255] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:33:50 2022] POST /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4/os-volume_attachments => generated 194 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:33:52.695129 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4394ef48-a624-4887-b807-0cbff8a7d598 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:52.695728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4394ef48-a624-4887-b807-0cbff8a7d598 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:52.701799 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4394ef48-a624-4887-b807-0cbff8a7d598 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:52.702244 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4394ef48-a624-4887-b807-0cbff8a7d598 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:52.703366 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4394ef48-a624-4887-b807-0cbff8a7d598 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:52.703591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4394ef48-a624-4887-b807-0cbff8a7d598 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:52.915525 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4394ef48-a624-4887-b807-0cbff8a7d598 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:52.922910 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4394ef48-a624-4887-b807-0cbff8a7d598 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.231559 Jul 26 16:33:52.923478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 133/256] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:52 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:53.945894 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-833c608e-7613-47e5-a2b1-879da1d2ad6d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:53.947005 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-833c608e-7613-47e5-a2b1-879da1d2ad6d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:53.954984 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-833c608e-7613-47e5-a2b1-879da1d2ad6d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:53.955426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-833c608e-7613-47e5-a2b1-879da1d2ad6d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:53.956221 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-833c608e-7613-47e5-a2b1-879da1d2ad6d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:53.956714 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-833c608e-7613-47e5-a2b1-879da1d2ad6d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:54.084512 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-833c608e-7613-47e5-a2b1-879da1d2ad6d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:54.092026 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-833c608e-7613-47e5-a2b1-879da1d2ad6d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.152191 Jul 26 16:33:54.092693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 124/257] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:53 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:55.118194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-92eb3362-6e1a-47ea-8d9c-5006904ae48a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:55.118815 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-92eb3362-6e1a-47ea-8d9c-5006904ae48a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:55.125130 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-92eb3362-6e1a-47ea-8d9c-5006904ae48a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:55.125871 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-92eb3362-6e1a-47ea-8d9c-5006904ae48a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:55.126639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-92eb3362-6e1a-47ea-8d9c-5006904ae48a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:55.127069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-92eb3362-6e1a-47ea-8d9c-5006904ae48a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:55.256970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-92eb3362-6e1a-47ea-8d9c-5006904ae48a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:55.264233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-92eb3362-6e1a-47ea-8d9c-5006904ae48a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.150057 Jul 26 16:33:55.265011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 134/258] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:55 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:56.287331 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-522cce66-f112-430c-b7cc-1ac99eb3e67c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:56.287887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-522cce66-f112-430c-b7cc-1ac99eb3e67c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:56.294475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-522cce66-f112-430c-b7cc-1ac99eb3e67c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:56.294988 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-522cce66-f112-430c-b7cc-1ac99eb3e67c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:56.295750 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-522cce66-f112-430c-b7cc-1ac99eb3e67c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:56.296178 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-522cce66-f112-430c-b7cc-1ac99eb3e67c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:56.440805 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-522cce66-f112-430c-b7cc-1ac99eb3e67c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:56.449971 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-522cce66-f112-430c-b7cc-1ac99eb3e67c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.167009 Jul 26 16:33:56.450838 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 125/259] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:56 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:57.472723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-41228e45-b800-408b-8ae2-93c3591f308f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:57.479652 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-41228e45-b800-408b-8ae2-93c3591f308f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:57.480405 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41228e45-b800-408b-8ae2-93c3591f308f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:57.480960 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41228e45-b800-408b-8ae2-93c3591f308f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:57.481732 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41228e45-b800-408b-8ae2-93c3591f308f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:57.482170 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41228e45-b800-408b-8ae2-93c3591f308f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:57.656477 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-41228e45-b800-408b-8ae2-93c3591f308f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:57.667156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-41228e45-b800-408b-8ae2-93c3591f308f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.198341 Jul 26 16:33:57.667878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 135/260] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:57 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:58.690924 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-32f1a374-7a4e-4550-9248-a085d5905fe7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:58.691846 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-32f1a374-7a4e-4550-9248-a085d5905fe7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:58.698730 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32f1a374-7a4e-4550-9248-a085d5905fe7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:58.699168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32f1a374-7a4e-4550-9248-a085d5905fe7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:58.700089 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32f1a374-7a4e-4550-9248-a085d5905fe7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:58.700692 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32f1a374-7a4e-4550-9248-a085d5905fe7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:58.857340 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-32f1a374-7a4e-4550-9248-a085d5905fe7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:33:58.865561 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-32f1a374-7a4e-4550-9248-a085d5905fe7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.181476 Jul 26 16:33:58.866135 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 126/261] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:58 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:33:59.886601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-05613857-337e-4d6f-b095-e8da4148434f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:33:59.887187 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-05613857-337e-4d6f-b095-e8da4148434f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:33:59.893434 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-05613857-337e-4d6f-b095-e8da4148434f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:59.893874 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-05613857-337e-4d6f-b095-e8da4148434f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:33:59.895213 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-05613857-337e-4d6f-b095-e8da4148434f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:33:59.895641 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-05613857-337e-4d6f-b095-e8da4148434f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:00.032415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-05613857-337e-4d6f-b095-e8da4148434f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:00.042932 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-05613857-337e-4d6f-b095-e8da4148434f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.159896 Jul 26 16:34:00.044264 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 136/262] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:33:59 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:01.064636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-48d7947c-b5b2-4d90-9e12-5964a35ad11a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:01.065264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-48d7947c-b5b2-4d90-9e12-5964a35ad11a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:01.072444 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-48d7947c-b5b2-4d90-9e12-5964a35ad11a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:01.072895 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-48d7947c-b5b2-4d90-9e12-5964a35ad11a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:01.073659 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-48d7947c-b5b2-4d90-9e12-5964a35ad11a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:01.074091 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-48d7947c-b5b2-4d90-9e12-5964a35ad11a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:01.202524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-48d7947c-b5b2-4d90-9e12-5964a35ad11a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:01.210925 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-48d7947c-b5b2-4d90-9e12-5964a35ad11a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.150189 Jul 26 16:34:01.211491 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 127/263] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:01 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:02.232942 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a1976a1c-036c-466e-b350-165a2baf130f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:02.233688 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a1976a1c-036c-466e-b350-165a2baf130f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:02.235773 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=85 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:02.240562 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1976a1c-036c-466e-b350-165a2baf130f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:02.241000 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1976a1c-036c-466e-b350-165a2baf130f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:02.241762 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1976a1c-036c-466e-b350-165a2baf130f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:02.242197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1976a1c-036c-466e-b350-165a2baf130f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:02.416798 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a1976a1c-036c-466e-b350-165a2baf130f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:02.426887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a1976a1c-036c-466e-b350-165a2baf130f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.197730 Jul 26 16:34:02.428108 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 137/264] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:02 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:03.451575 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-273bc9fc-fe4c-4594-b372-34211b338327 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:03.452816 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-273bc9fc-fe4c-4594-b372-34211b338327 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:03.460588 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-273bc9fc-fe4c-4594-b372-34211b338327 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:03.461280 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-273bc9fc-fe4c-4594-b372-34211b338327 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:03.462126 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-273bc9fc-fe4c-4594-b372-34211b338327 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:03.462623 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-273bc9fc-fe4c-4594-b372-34211b338327 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:03.639345 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-273bc9fc-fe4c-4594-b372-34211b338327 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:03.648407 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-273bc9fc-fe4c-4594-b372-34211b338327 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.201009 Jul 26 16:34:03.648974 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 128/265] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:03 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:34:03.778089 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-43e20c26-ba5c-451e-b3e4-32fd3eb411c2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:03.778632 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-43e20c26-ba5c-451e-b3e4-32fd3eb411c2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:03.784506 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-43e20c26-ba5c-451e-b3e4-32fd3eb411c2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:03.785669 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-43e20c26-ba5c-451e-b3e4-32fd3eb411c2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:03.786282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-43e20c26-ba5c-451e-b3e4-32fd3eb411c2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:03.786657 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-43e20c26-ba5c-451e-b3e4-32fd3eb411c2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:03.811370 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-43e20c26-ba5c-451e-b3e4-32fd3eb411c2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Going to try to terminate instance {{(pid=124821) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:34:04.330812 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-43e20c26-ba5c-451e-b3e4-32fd3eb411c2 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "DELETE /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 204 len: 0 microversion: 2.1 time: 0.556390 Jul 26 16:34:04.331420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 138/266] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:34:03 2022] DELETE /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:34:04.345211 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f884450d-ec2e-4a76-826a-605eacf0b494 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:04.345859 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f884450d-ec2e-4a76-826a-605eacf0b494 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:04.352326 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f884450d-ec2e-4a76-826a-605eacf0b494 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:04.352808 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f884450d-ec2e-4a76-826a-605eacf0b494 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:04.353574 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f884450d-ec2e-4a76-826a-605eacf0b494 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:04.354011 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f884450d-ec2e-4a76-826a-605eacf0b494 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:04.499627 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f884450d-ec2e-4a76-826a-605eacf0b494 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:04.508185 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f884450d-ec2e-4a76-826a-605eacf0b494 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1558 microversion: 2.1 time: 0.166727 Jul 26 16:34:04.508970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 129/267] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:04 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:04.671667 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3834073d-76d3-4a22-9126-69af07c0b1d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:04.672371 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3834073d-76d3-4a22-9126-69af07c0b1d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:04.678379 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3834073d-76d3-4a22-9126-69af07c0b1d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:04.678829 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3834073d-76d3-4a22-9126-69af07c0b1d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:04.679595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3834073d-76d3-4a22-9126-69af07c0b1d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:04.680028 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3834073d-76d3-4a22-9126-69af07c0b1d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:04.813777 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3834073d-76d3-4a22-9126-69af07c0b1d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:04.823066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3834073d-76d3-4a22-9126-69af07c0b1d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.155578 Jul 26 16:34:04.823883 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 139/268] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:04 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:05.537333 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cb17b552-cb9f-4e03-8373-5623affaf8a8 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:05.537916 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cb17b552-cb9f-4e03-8373-5623affaf8a8 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:05.544113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cb17b552-cb9f-4e03-8373-5623affaf8a8 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:05.544581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cb17b552-cb9f-4e03-8373-5623affaf8a8 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:05.545456 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cb17b552-cb9f-4e03-8373-5623affaf8a8 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:05.545886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cb17b552-cb9f-4e03-8373-5623affaf8a8 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:05.690401 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cb17b552-cb9f-4e03-8373-5623affaf8a8 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:05.699690 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cb17b552-cb9f-4e03-8373-5623affaf8a8 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1558 microversion: 2.1 time: 0.173034 Jul 26 16:34:05.714503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 130/269] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:05 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1558 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:05.843067 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1f5340ce-5c1c-4480-9a5f-8aac0fa398b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:05.843674 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1f5340ce-5c1c-4480-9a5f-8aac0fa398b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:05.850251 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f5340ce-5c1c-4480-9a5f-8aac0fa398b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:05.850701 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f5340ce-5c1c-4480-9a5f-8aac0fa398b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:05.851459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f5340ce-5c1c-4480-9a5f-8aac0fa398b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:05.851895 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f5340ce-5c1c-4480-9a5f-8aac0fa398b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:05.989066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1f5340ce-5c1c-4480-9a5f-8aac0fa398b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:05.992721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:05.997106 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1f5340ce-5c1c-4480-9a5f-8aac0fa398b5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.157956 Jul 26 16:34:05.997675 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 140/270] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:05 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:06.722231 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a3359e5b-7c0e-463b-97eb-b0063435c1dd tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:06.723377 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a3359e5b-7c0e-463b-97eb-b0063435c1dd tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:06.732524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a3359e5b-7c0e-463b-97eb-b0063435c1dd tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:06.733085 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a3359e5b-7c0e-463b-97eb-b0063435c1dd tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:06.733913 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a3359e5b-7c0e-463b-97eb-b0063435c1dd tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:06.734407 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a3359e5b-7c0e-463b-97eb-b0063435c1dd tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:06.756878 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:06.871553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a3359e5b-7c0e-463b-97eb-b0063435c1dd tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:06.879837 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a3359e5b-7c0e-463b-97eb-b0063435c1dd tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1558 microversion: 2.1 time: 0.161598 Jul 26 16:34:06.880407 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 131/271] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:06 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:07.018256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f713a8f7-0057-4e00-8aef-49a85958aac7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:07.018891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f713a8f7-0057-4e00-8aef-49a85958aac7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:07.025289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f713a8f7-0057-4e00-8aef-49a85958aac7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:07.025737 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f713a8f7-0057-4e00-8aef-49a85958aac7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:07.026499 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f713a8f7-0057-4e00-8aef-49a85958aac7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:07.026925 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f713a8f7-0057-4e00-8aef-49a85958aac7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:07.180575 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f713a8f7-0057-4e00-8aef-49a85958aac7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:07.189426 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f713a8f7-0057-4e00-8aef-49a85958aac7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.175436 Jul 26 16:34:07.190075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 141/272] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:07 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:07.812828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-032134ad-9bdf-4234-a691-992d7de9712d req-ead10d35-bf4c-4e01-91a3-dc0882d6be13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4", "name": "network-vif-deleted", "tag": "26e755d4-3673-4a1f-82d7-5cb16e9faf7f"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:34:07.823084 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-032134ad-9bdf-4234-a691-992d7de9712d req-ead10d35-bf4c-4e01-91a3-dc0882d6be13 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:07.823527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-032134ad-9bdf-4234-a691-992d7de9712d req-ead10d35-bf4c-4e01-91a3-dc0882d6be13 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:07.835455 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-032134ad-9bdf-4234-a691-992d7de9712d req-ead10d35-bf4c-4e01-91a3-dc0882d6be13 service nova] Creating event network-vif-deleted:26e755d4-3673-4a1f-82d7-5cb16e9faf7f for instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 on hv-cinder-85104 Jul 26 16:34:07.840737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-032134ad-9bdf-4234-a691-992d7de9712d req-ead10d35-bf4c-4e01-91a3-dc0882d6be13 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031693 Jul 26 16:34:07.841343 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 132/273] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:34:07.903578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8ec03563-1e07-4be6-843a-b336784da512 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:07.904327 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8ec03563-1e07-4be6-843a-b336784da512 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:07.912782 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ec03563-1e07-4be6-843a-b336784da512 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:07.913348 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ec03563-1e07-4be6-843a-b336784da512 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:07.914352 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ec03563-1e07-4be6-843a-b336784da512 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:07.914996 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ec03563-1e07-4be6-843a-b336784da512 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:07.979536 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8ec03563-1e07-4be6-843a-b336784da512 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:07.987359 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8ec03563-1e07-4be6-843a-b336784da512 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1516 microversion: 2.1 time: 0.089416 Jul 26 16:34:07.987934 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 142/274] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:07 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1516 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:08.212261 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-539b5d7d-5d72-4ec1-8bc4-2799f04152a6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:08.213080 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-539b5d7d-5d72-4ec1-8bc4-2799f04152a6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:08.219306 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-539b5d7d-5d72-4ec1-8bc4-2799f04152a6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:08.219813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-539b5d7d-5d72-4ec1-8bc4-2799f04152a6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:08.220647 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-539b5d7d-5d72-4ec1-8bc4-2799f04152a6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:08.221030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-539b5d7d-5d72-4ec1-8bc4-2799f04152a6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:08.351151 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-539b5d7d-5d72-4ec1-8bc4-2799f04152a6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:08.358427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-539b5d7d-5d72-4ec1-8bc4-2799f04152a6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.150318 Jul 26 16:34:08.358997 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 133/275] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:08 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:09.007937 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:09.008894 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:09.015365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:09.017133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:09.017995 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:09.018434 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:09.048703 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:09.049145 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:09.049577 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lazy-loading 'fault' on Instance uuid ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:34:09.096101 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db18d0211f2a4e1c8949726ded7a9bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '940d1a5ec6514d18946628b99f16a96e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:09.105327 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-cf979c07-fe31-4ee9-b5fe-19aa8d3a0e68 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 200 len: 1355 microversion: 2.1 time: 0.101381 Jul 26 16:34:09.105907 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 143/276] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:09 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 1355 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:09.378984 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f36ecd06-4e4c-49c1-8cf5-527ede200fcd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:09.380042 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f36ecd06-4e4c-49c1-8cf5-527ede200fcd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:09.387134 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f36ecd06-4e4c-49c1-8cf5-527ede200fcd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:09.387585 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f36ecd06-4e4c-49c1-8cf5-527ede200fcd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:09.388346 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f36ecd06-4e4c-49c1-8cf5-527ede200fcd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:09.388807 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f36ecd06-4e4c-49c1-8cf5-527ede200fcd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:09.532755 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f36ecd06-4e4c-49c1-8cf5-527ede200fcd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:09.538699 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f36ecd06-4e4c-49c1-8cf5-527ede200fcd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.163524 Jul 26 16:34:09.539940 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 134/277] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:09 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:10.127147 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b3b1d987-f0c9-48c8-b59d-3579bd97a161 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:10.127808 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b3b1d987-f0c9-48c8-b59d-3579bd97a161 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:10.134179 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3b1d987-f0c9-48c8-b59d-3579bd97a161 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:10.134622 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3b1d987-f0c9-48c8-b59d-3579bd97a161 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:10.135389 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3b1d987-f0c9-48c8-b59d-3579bd97a161 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:10.135819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3b1d987-f0c9-48c8-b59d-3579bd97a161 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:10.150595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-b3b1d987-f0c9-48c8-b59d-3579bd97a161 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] HTTP exception thrown: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b3b1d987-f0c9-48c8-b59d-3579bd97a161 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Request method failure captured: Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 HTTP/1.1 Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcv1031mooPEy0Cd0d4lUsK6TvEyV4gSo_veVEo0KX2mLMBUaXYB2th8Pul-eQSscmJHIjwX41qEAtNiFF8GfEgqZv4gmtn5ooZEuiUwLg4Wj0oEg4A3FVZsqV5sktZfcf60F6vSqfm-qmoNxXb8wahPCSdzGHsxf_91BSCpHg8R6M Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 940d1a5ec6514d18946628b99f16a96e Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:34:10.155158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_940d1a5ec6514d18946628b99f16a96e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 940d1a5ec6514d18946628b99f16a96e Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-DeleteServersTestJSON-565081753-project Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: db18d0211f2a4e1c8949726ded7a9bb3 Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-DeleteServersTestJSON-565081753-project Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:10.156639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': 'ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4'} Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:34:10.157441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:10.158741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:10.159972 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b3b1d987-f0c9-48c8-b59d-3579bd97a161 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Returning 404 to user: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:34:10.159972 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b3b1d987-f0c9-48c8-b59d-3579bd97a161 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 404 len: 111 microversion: 2.1 time: 0.033827 Jul 26 16:34:10.159972 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 144/278] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:10 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:34:10.560138 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5094d380-8259-4a1f-b282-3f1dd5d7a8bc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:10.560795 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5094d380-8259-4a1f-b282-3f1dd5d7a8bc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:10.563329 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=61 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:10.568756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5094d380-8259-4a1f-b282-3f1dd5d7a8bc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:10.569214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5094d380-8259-4a1f-b282-3f1dd5d7a8bc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:10.569969 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5094d380-8259-4a1f-b282-3f1dd5d7a8bc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:10.570401 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5094d380-8259-4a1f-b282-3f1dd5d7a8bc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:10.702767 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5094d380-8259-4a1f-b282-3f1dd5d7a8bc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:10.710972 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5094d380-8259-4a1f-b282-3f1dd5d7a8bc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.154886 Jul 26 16:34:10.711752 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 135/279] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:10 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:11.021598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-08774d84-c141-463e-9c65-175ba5295bb1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:11.023861 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-08774d84-c141-463e-9c65-175ba5295bb1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:11.030334 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-08774d84-c141-463e-9c65-175ba5295bb1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:11.030783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-08774d84-c141-463e-9c65-175ba5295bb1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:11.031553 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-08774d84-c141-463e-9c65-175ba5295bb1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:11.032320 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-08774d84-c141-463e-9c65-175ba5295bb1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:11.047274 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-08774d84-c141-463e-9c65-175ba5295bb1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] HTTP exception thrown: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-08774d84-c141-463e-9c65-175ba5295bb1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Request method failure captured: Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4/os-volume_attachments HTTP/1.1 Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcv1031mooPEy0Cd0d4lUsK6TvEyV4gSo_veVEo0KX2mLMBUaXYB2th8Pul-eQSscmJHIjwX41qEAtNiFF8GfEgqZv4gmtn5ooZEuiUwLg4Wj0oEg4A3FVZsqV5sktZfcf60F6vSqfm-qmoNxXb8wahPCSdzGHsxf_91BSCpHg8R6M Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 940d1a5ec6514d18946628b99f16a96e Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:34:11.052760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_940d1a5ec6514d18946628b99f16a96e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 940d1a5ec6514d18946628b99f16a96e Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-DeleteServersTestJSON-565081753-project Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: db18d0211f2a4e1c8949726ded7a9bb3 Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-DeleteServersTestJSON-565081753-project Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:11.054571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'server_id': 'ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4'} Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:34:11.055231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:11.056245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:11.057520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-08774d84-c141-463e-9c65-175ba5295bb1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Returning 404 to user: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:34:11.057520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-08774d84-c141-463e-9c65-175ba5295bb1 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033576 Jul 26 16:34:11.057520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 145/280] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:34:11 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:34:11.742868 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-227a41da-b5cf-490b-91fa-4e0c89e66abf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:11.743469 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-227a41da-b5cf-490b-91fa-4e0c89e66abf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:11.750544 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-227a41da-b5cf-490b-91fa-4e0c89e66abf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:11.750985 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-227a41da-b5cf-490b-91fa-4e0c89e66abf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:11.751803 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-227a41da-b5cf-490b-91fa-4e0c89e66abf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:11.752228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-227a41da-b5cf-490b-91fa-4e0c89e66abf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:11.880695 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-227a41da-b5cf-490b-91fa-4e0c89e66abf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:11.888215 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-227a41da-b5cf-490b-91fa-4e0c89e66abf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.149133 Jul 26 16:34:11.888823 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 136/281] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:11 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:12.909456 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9b99c883-621d-4a0b-9a70-02d367bc94e3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:12.913697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9b99c883-621d-4a0b-9a70-02d367bc94e3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:12.916904 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9b99c883-621d-4a0b-9a70-02d367bc94e3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:12.917352 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9b99c883-621d-4a0b-9a70-02d367bc94e3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:12.918111 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9b99c883-621d-4a0b-9a70-02d367bc94e3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:12.918540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9b99c883-621d-4a0b-9a70-02d367bc94e3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:13.047196 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9b99c883-621d-4a0b-9a70-02d367bc94e3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:13.054840 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9b99c883-621d-4a0b-9a70-02d367bc94e3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.149611 Jul 26 16:34:13.055395 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 146/282] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:12 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:14.075417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2d216759-7c4e-4dce-a0e5-d01610098bb7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:14.076171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2d216759-7c4e-4dce-a0e5-d01610098bb7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:14.083291 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d216759-7c4e-4dce-a0e5-d01610098bb7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:14.083858 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d216759-7c4e-4dce-a0e5-d01610098bb7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:14.084644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d216759-7c4e-4dce-a0e5-d01610098bb7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:14.085489 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d216759-7c4e-4dce-a0e5-d01610098bb7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:14.216287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2d216759-7c4e-4dce-a0e5-d01610098bb7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:14.224292 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2d216759-7c4e-4dce-a0e5-d01610098bb7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.152718 Jul 26 16:34:14.225021 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 137/283] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:14 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:15.245726 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6f9ac163-eb26-4bcc-9d14-4c6e1fea5799 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:15.246250 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6f9ac163-eb26-4bcc-9d14-4c6e1fea5799 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:15.252351 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f9ac163-eb26-4bcc-9d14-4c6e1fea5799 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:15.252822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f9ac163-eb26-4bcc-9d14-4c6e1fea5799 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:15.253586 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f9ac163-eb26-4bcc-9d14-4c6e1fea5799 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:15.253998 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f9ac163-eb26-4bcc-9d14-4c6e1fea5799 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:15.388172 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6f9ac163-eb26-4bcc-9d14-4c6e1fea5799 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:15.395927 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6f9ac163-eb26-4bcc-9d14-4c6e1fea5799 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.154062 Jul 26 16:34:15.396498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 147/284] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:15 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:16.416320 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5e882073-7a97-44d2-9e80-30df9a66a7a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:16.416950 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5e882073-7a97-44d2-9e80-30df9a66a7a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:16.423371 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5e882073-7a97-44d2-9e80-30df9a66a7a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:16.423831 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5e882073-7a97-44d2-9e80-30df9a66a7a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:16.424694 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5e882073-7a97-44d2-9e80-30df9a66a7a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:16.425122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5e882073-7a97-44d2-9e80-30df9a66a7a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:16.559902 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5e882073-7a97-44d2-9e80-30df9a66a7a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:16.567843 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5e882073-7a97-44d2-9e80-30df9a66a7a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.155307 Jul 26 16:34:16.568490 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 138/285] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:16 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:17.588993 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ad269b32-0091-4ae6-8bbd-050e046d6d99 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:17.589600 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ad269b32-0091-4ae6-8bbd-050e046d6d99 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:17.595957 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ad269b32-0091-4ae6-8bbd-050e046d6d99 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:17.596430 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ad269b32-0091-4ae6-8bbd-050e046d6d99 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:17.597206 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ad269b32-0091-4ae6-8bbd-050e046d6d99 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:17.597650 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ad269b32-0091-4ae6-8bbd-050e046d6d99 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:17.734460 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ad269b32-0091-4ae6-8bbd-050e046d6d99 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:17.742721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ad269b32-0091-4ae6-8bbd-050e046d6d99 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.157529 Jul 26 16:34:17.743281 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 148/286] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:17 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:18.763454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-718615fc-d0af-42ed-98bc-8309f026c537 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:18.764072 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-718615fc-d0af-42ed-98bc-8309f026c537 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:18.770734 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-718615fc-d0af-42ed-98bc-8309f026c537 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:18.771184 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-718615fc-d0af-42ed-98bc-8309f026c537 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:18.771940 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-718615fc-d0af-42ed-98bc-8309f026c537 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:18.772372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-718615fc-d0af-42ed-98bc-8309f026c537 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:18.904575 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-718615fc-d0af-42ed-98bc-8309f026c537 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:18.912305 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-718615fc-d0af-42ed-98bc-8309f026c537 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.153073 Jul 26 16:34:18.913095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 139/287] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:18 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:19.933442 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-95307890-c220-4bee-bc6c-554f0b0b6b37 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:19.934111 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-95307890-c220-4bee-bc6c-554f0b0b6b37 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:19.940057 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95307890-c220-4bee-bc6c-554f0b0b6b37 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:19.941017 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95307890-c220-4bee-bc6c-554f0b0b6b37 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:19.941280 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95307890-c220-4bee-bc6c-554f0b0b6b37 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:19.941710 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95307890-c220-4bee-bc6c-554f0b0b6b37 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:20.066440 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-95307890-c220-4bee-bc6c-554f0b0b6b37 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:20.074621 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-95307890-c220-4bee-bc6c-554f0b0b6b37 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.144961 Jul 26 16:34:20.075122 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 149/288] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:19 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:20.404058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-92f1765a-6676-48b8-85bc-4cebdf22c5b5 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:20.404627 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-92f1765a-6676-48b8-85bc-4cebdf22c5b5 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:20.411772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-92f1765a-6676-48b8-85bc-4cebdf22c5b5 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:20.412227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-92f1765a-6676-48b8-85bc-4cebdf22c5b5 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:20.413045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-92f1765a-6676-48b8-85bc-4cebdf22c5b5 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:20.413607 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-92f1765a-6676-48b8-85bc-4cebdf22c5b5 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:20.428681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-92f1765a-6676-48b8-85bc-4cebdf22c5b5 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] HTTP exception thrown: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-92f1765a-6676-48b8-85bc-4cebdf22c5b5 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Request method failure captured: Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: DELETE /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 HTTP/1.1 Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcv1031mooPEy0Cd0d4lUsK6TvEyV4gSo_veVEo0KX2mLMBUaXYB2th8Pul-eQSscmJHIjwX41qEAtNiFF8GfEgqZv4gmtn5ooZEuiUwLg4Wj0oEg4A3FVZsqV5sktZfcf60F6vSqfm-qmoNxXb8wahPCSdzGHsxf_91BSCpHg8R6M Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 940d1a5ec6514d18946628b99f16a96e Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:34:20.432533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_940d1a5ec6514d18946628b99f16a96e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 940d1a5ec6514d18946628b99f16a96e Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-DeleteServersTestJSON-565081753-project Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: db18d0211f2a4e1c8949726ded7a9bb3 Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-DeleteServersTestJSON-565081753-project Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:20.434067 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': 'ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4'} Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:34:20.435025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:20.436139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:34:20.437413 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-92f1765a-6676-48b8-85bc-4cebdf22c5b5 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Returning 404 to user: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:34:20.437413 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-92f1765a-6676-48b8-85bc-4cebdf22c5b5 tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "DELETE /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 404 len: 111 microversion: 2.1 time: 0.033670 Jul 26 16:34:20.437413 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 140/289] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:34:20 2022] DELETE /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:34:20.447589 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2867a686-1227-4e14-9762-776ad331c99d tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:20.448228 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2867a686-1227-4e14-9762-776ad331c99d tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] [instance: ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:20.454689 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2867a686-1227-4e14-9762-776ad331c99d tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:20.455154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2867a686-1227-4e14-9762-776ad331c99d tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:20.456059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2867a686-1227-4e14-9762-776ad331c99d tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:20.456366 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2867a686-1227-4e14-9762-776ad331c99d tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:20.469986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-2867a686-1227-4e14-9762-776ad331c99d tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] HTTP exception thrown: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2867a686-1227-4e14-9762-776ad331c99d tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Request method failure captured: Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 HTTP/1.1 Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcv1031mooPEy0Cd0d4lUsK6TvEyV4gSo_veVEo0KX2mLMBUaXYB2th8Pul-eQSscmJHIjwX41qEAtNiFF8GfEgqZv4gmtn5ooZEuiUwLg4Wj0oEg4A3FVZsqV5sktZfcf60F6vSqfm-qmoNxXb8wahPCSdzGHsxf_91BSCpHg8R6M Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 940d1a5ec6514d18946628b99f16a96e Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:34:20.471498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/940d1a5ec6514d18946628b99f16a96e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_940d1a5ec6514d18946628b99f16a96e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 940d1a5ec6514d18946628b99f16a96e Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-DeleteServersTestJSON-565081753 Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-DeleteServersTestJSON-565081753-project Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: db18d0211f2a4e1c8949726ded7a9bb3 Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-DeleteServersTestJSON-565081753-project Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:20.472658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': 'ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4'} Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:34:20.473338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. Jul 26 16:34:20.478741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:20.480213 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2867a686-1227-4e14-9762-776ad331c99d tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] Returning 404 to user: Instance ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:34:20.480213 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2867a686-1227-4e14-9762-776ad331c99d tempest-DeleteServersTestJSON-565081753 tempest-DeleteServersTestJSON-565081753-project] 10.222.0.144 "GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4" status: 404 len: 111 microversion: 2.1 time: 0.029092 Jul 26 16:34:20.480213 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 150/290] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:20 2022] GET /compute/v2.1/servers/ea4d50cc-1ce7-4b80-9a6e-7efd7947e0c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 16:34:21.096160 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-59cf01b1-6de3-4c27-b861-3e20643650d5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:21.097016 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-59cf01b1-6de3-4c27-b861-3e20643650d5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:21.103859 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-59cf01b1-6de3-4c27-b861-3e20643650d5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:21.104790 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-59cf01b1-6de3-4c27-b861-3e20643650d5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:21.115685 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-59cf01b1-6de3-4c27-b861-3e20643650d5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:21.116227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-59cf01b1-6de3-4c27-b861-3e20643650d5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:21.435550 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-59cf01b1-6de3-4c27-b861-3e20643650d5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:21.443166 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-59cf01b1-6de3-4c27-b861-3e20643650d5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.351223 Jul 26 16:34:21.455237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 141/291] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:21 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:22.463982 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8c18e38b-4e44-403e-b941-a4e3ccb4a706 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:22.464726 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8c18e38b-4e44-403e-b941-a4e3ccb4a706 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:22.482470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8c18e38b-4e44-403e-b941-a4e3ccb4a706 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:22.482470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8c18e38b-4e44-403e-b941-a4e3ccb4a706 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:22.482470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8c18e38b-4e44-403e-b941-a4e3ccb4a706 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:22.482470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8c18e38b-4e44-403e-b941-a4e3ccb4a706 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:22.887295 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8c18e38b-4e44-403e-b941-a4e3ccb4a706 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:22.897842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8c18e38b-4e44-403e-b941-a4e3ccb4a706 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.437506 Jul 26 16:34:22.917356 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 151/292] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:22 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:23.938923 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1d964cee-93cd-409e-8f1c-18f510313a51 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:23.939603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1d964cee-93cd-409e-8f1c-18f510313a51 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:23.948877 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1d964cee-93cd-409e-8f1c-18f510313a51 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:23.949330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1d964cee-93cd-409e-8f1c-18f510313a51 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:23.950151 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1d964cee-93cd-409e-8f1c-18f510313a51 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:23.950583 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1d964cee-93cd-409e-8f1c-18f510313a51 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:24.091332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1d964cee-93cd-409e-8f1c-18f510313a51 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:24.099707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1d964cee-93cd-409e-8f1c-18f510313a51 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.164934 Jul 26 16:34:24.100265 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 142/293] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:23 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:25.146699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b64714fa-d920-4632-85f5-06cfbd36b5c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:25.147358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b64714fa-d920-4632-85f5-06cfbd36b5c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:25.155150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b64714fa-d920-4632-85f5-06cfbd36b5c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:25.155595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b64714fa-d920-4632-85f5-06cfbd36b5c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:25.158737 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b64714fa-d920-4632-85f5-06cfbd36b5c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:25.159179 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b64714fa-d920-4632-85f5-06cfbd36b5c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:25.340477 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b64714fa-d920-4632-85f5-06cfbd36b5c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:25.349352 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b64714fa-d920-4632-85f5-06cfbd36b5c9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.210992 Jul 26 16:34:25.350551 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 152/294] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:25 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:26.370782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e3d6c938-f76a-48c0-9b01-394185db2d7c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:26.371384 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e3d6c938-f76a-48c0-9b01-394185db2d7c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:26.378261 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3d6c938-f76a-48c0-9b01-394185db2d7c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:26.383716 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3d6c938-f76a-48c0-9b01-394185db2d7c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:26.383716 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3d6c938-f76a-48c0-9b01-394185db2d7c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:26.383716 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3d6c938-f76a-48c0-9b01-394185db2d7c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:26.514093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e3d6c938-f76a-48c0-9b01-394185db2d7c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:26.522880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e3d6c938-f76a-48c0-9b01-394185db2d7c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1524 microversion: 2.1 time: 0.155900 Jul 26 16:34:26.523434 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 143/295] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:26 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1524 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:27.542913 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-bdecc404-e549-4533-8c17-1e00f739258b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:27.543554 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-bdecc404-e549-4533-8c17-1e00f739258b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:27.549660 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bdecc404-e549-4533-8c17-1e00f739258b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:27.550110 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bdecc404-e549-4533-8c17-1e00f739258b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:27.550882 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bdecc404-e549-4533-8c17-1e00f739258b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:27.551320 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bdecc404-e549-4533-8c17-1e00f739258b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:27.683830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-bdecc404-e549-4533-8c17-1e00f739258b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:27.691339 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-bdecc404-e549-4533-8c17-1e00f739258b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1504 microversion: 2.1 time: 0.152188 Jul 26 16:34:27.691900 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 153/296] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:27 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:27.712136 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8e01fd0d-5188-466c-86cc-3488b0cc82a0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:27.712822 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8e01fd0d-5188-466c-86cc-3488b0cc82a0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:27.719339 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e01fd0d-5188-466c-86cc-3488b0cc82a0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:27.719780 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e01fd0d-5188-466c-86cc-3488b0cc82a0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:27.720636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e01fd0d-5188-466c-86cc-3488b0cc82a0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:27.721064 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e01fd0d-5188-466c-86cc-3488b0cc82a0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:27.857210 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8e01fd0d-5188-466c-86cc-3488b0cc82a0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:27.865725 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8e01fd0d-5188-466c-86cc-3488b0cc82a0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1519 microversion: 2.1 time: 0.157969 Jul 26 16:34:27.866281 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 144/297] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:27 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:31.260181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e91027d2-9769-428b-82f4-0edfdc88c185 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:34:31.263774 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e91027d2-9769-428b-82f4-0edfdc88c185 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:31.270942 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e91027d2-9769-428b-82f4-0edfdc88c185 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:31.271857 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e91027d2-9769-428b-82f4-0edfdc88c185 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:31.273453 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e91027d2-9769-428b-82f4-0edfdc88c185 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:31.274050 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e91027d2-9769-428b-82f4-0edfdc88c185 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:31.300047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-e91027d2-9769-428b-82f4-0edfdc88c185 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lazy-loading 'flavor' on Instance uuid fad766a1-6214-4f3a-aa55-50ca2baa6b64 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:34:31.897331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e91027d2-9769-428b-82f4-0edfdc88c185 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64/action" status: 200 len: 32 microversion: 2.1 time: 0.642711 Jul 26 16:34:31.903222 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 154/298] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:34:31 2022] POST /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64/action => generated 32 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 16:34:31.914191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e660b8b4-7019-4de3-8f92-b832b363af22 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:31.914989 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e660b8b4-7019-4de3-8f92-b832b363af22 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:31.927615 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e660b8b4-7019-4de3-8f92-b832b363af22 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:31.935186 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e660b8b4-7019-4de3-8f92-b832b363af22 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:31.935186 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e660b8b4-7019-4de3-8f92-b832b363af22 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:31.935186 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e660b8b4-7019-4de3-8f92-b832b363af22 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:32.134258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e660b8b4-7019-4de3-8f92-b832b363af22 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:32.142613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e660b8b4-7019-4de3-8f92-b832b363af22 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.234309 Jul 26 16:34:32.143459 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 145/299] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:31 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:33.169591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-628a993f-9e5f-46ad-bf44-04b6af284e03 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:33.172041 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-628a993f-9e5f-46ad-bf44-04b6af284e03 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:33.182995 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-628a993f-9e5f-46ad-bf44-04b6af284e03 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:33.182995 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-628a993f-9e5f-46ad-bf44-04b6af284e03 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:33.182995 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-628a993f-9e5f-46ad-bf44-04b6af284e03 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:33.184330 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-628a993f-9e5f-46ad-bf44-04b6af284e03 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:33.390897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-628a993f-9e5f-46ad-bf44-04b6af284e03 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:33.403840 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-628a993f-9e5f-46ad-bf44-04b6af284e03 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.243671 Jul 26 16:34:33.404642 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 155/300] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:33 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:34.426237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-04cb4c23-a15a-4add-bf22-3914d2cf4612 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:34.427063 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-04cb4c23-a15a-4add-bf22-3914d2cf4612 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:34.434477 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-04cb4c23-a15a-4add-bf22-3914d2cf4612 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:34.435035 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-04cb4c23-a15a-4add-bf22-3914d2cf4612 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:34.436095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-04cb4c23-a15a-4add-bf22-3914d2cf4612 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:34.436682 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-04cb4c23-a15a-4add-bf22-3914d2cf4612 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:34.611721 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-04cb4c23-a15a-4add-bf22-3914d2cf4612 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:34.621539 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-04cb4c23-a15a-4add-bf22-3914d2cf4612 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.198943 Jul 26 16:34:34.623267 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 146/301] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:34 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:35.643710 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1112612b-cc0a-444e-b8e3-d3e8308f40cd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:35.645034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1112612b-cc0a-444e-b8e3-d3e8308f40cd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:35.648161 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:35.654641 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1112612b-cc0a-444e-b8e3-d3e8308f40cd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:35.656463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1112612b-cc0a-444e-b8e3-d3e8308f40cd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:35.658001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1112612b-cc0a-444e-b8e3-d3e8308f40cd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:35.658451 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1112612b-cc0a-444e-b8e3-d3e8308f40cd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:35.862979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1112612b-cc0a-444e-b8e3-d3e8308f40cd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:35.873515 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1112612b-cc0a-444e-b8e3-d3e8308f40cd tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.233761 Jul 26 16:34:35.874934 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 156/302] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:35 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:36.448922 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ca8f0626-60e6-4fd4-96ed-e606dd5f9a3a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Action: 'create', calling method: .version_select at 0x7f4b6c41db80>, body: {"keypair": {"name": "tempest-keypair-1392021124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvj81qzmgvhFAJ6+B9v61lCei8sIAlFLZlA5HAaDLIl6QtHMuiBTvbts95kX2z895NV9t1oSpeI6V6qrgippkoPyoKCCIcC9bMRxUHVrlEdjOVXOETO8twjAM+9it9KWw=="}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:34:36.468054 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-ca8f0626-60e6-4fd4-96ed-e606dd5f9a3a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Getting quotas for project f6a8f13fe22741d6843f193a0a959e57. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:34:36.473008 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-ca8f0626-60e6-4fd4-96ed-e606dd5f9a3a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Getting quotas for user 09de5ea60b9943adacc765b5ecdccb71 and project f6a8f13fe22741d6843f193a0a959e57. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:34:36.674367 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ca8f0626-60e6-4fd4-96ed-e606dd5f9a3a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.363093 Jul 26 16:34:36.674957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 147/303] 10.222.0.144 () {62 vars in 1205 bytes} [Tue Jul 26 16:34:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 364 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 16:34:36.897389 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8dfe25c2-dbe5-4062-a123-3bb93783daca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:36.897823 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8dfe25c2-dbe5-4062-a123-3bb93783daca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:36.908140 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8dfe25c2-dbe5-4062-a123-3bb93783daca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:36.915143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8dfe25c2-dbe5-4062-a123-3bb93783daca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:36.915143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8dfe25c2-dbe5-4062-a123-3bb93783daca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:36.915143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8dfe25c2-dbe5-4062-a123-3bb93783daca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:36.915580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:37.214909 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8dfe25c2-dbe5-4062-a123-3bb93783daca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:37.234977 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8dfe25c2-dbe5-4062-a123-3bb93783daca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.342355 Jul 26 16:34:37.237159 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 157/304] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:36 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:38.260568 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-58459117-db30-43fb-b07a-8328d70ae7a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:38.261472 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-58459117-db30-43fb-b07a-8328d70ae7a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:38.277463 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58459117-db30-43fb-b07a-8328d70ae7a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:38.286007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58459117-db30-43fb-b07a-8328d70ae7a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:38.286007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58459117-db30-43fb-b07a-8328d70ae7a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:38.286007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58459117-db30-43fb-b07a-8328d70ae7a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:38.526879 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-58459117-db30-43fb-b07a-8328d70ae7a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:38.540706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-58459117-db30-43fb-b07a-8328d70ae7a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.284723 Jul 26 16:34:38.542141 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 148/305] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:38 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:39.569621 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-85e1abd1-2861-4be3-bf5b-8d987cdcda1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:39.570766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-85e1abd1-2861-4be3-bf5b-8d987cdcda1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:39.583220 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-85e1abd1-2861-4be3-bf5b-8d987cdcda1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:39.583912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-85e1abd1-2861-4be3-bf5b-8d987cdcda1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:39.584946 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-85e1abd1-2861-4be3-bf5b-8d987cdcda1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:39.585722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-85e1abd1-2861-4be3-bf5b-8d987cdcda1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:39.775499 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-85e1abd1-2861-4be3-bf5b-8d987cdcda1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:39.783020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-85e1abd1-2861-4be3-bf5b-8d987cdcda1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.218166 Jul 26 16:34:39.783597 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 158/306] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:39 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:40.805076 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f9505270-b7df-4758-bf2f-f92cd26f9b82 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:40.805684 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f9505270-b7df-4758-bf2f-f92cd26f9b82 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:40.817938 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9505270-b7df-4758-bf2f-f92cd26f9b82 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:40.819945 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9505270-b7df-4758-bf2f-f92cd26f9b82 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:40.820451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9505270-b7df-4758-bf2f-f92cd26f9b82 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:40.821256 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9505270-b7df-4758-bf2f-f92cd26f9b82 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:40.878876 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-498258644", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "862673cc-ea89-444e-b2bd-e75d18a6efab"}], "security_groups": [{"name": "tempest-securitygroup--523084248"}], "key_name": "tempest-keypair-1392021124", "user_data": "}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:34:40.967684 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f9505270-b7df-4758-bf2f-f92cd26f9b82 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:40.975299 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f9505270-b7df-4758-bf2f-f92cd26f9b82 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.174115 Jul 26 16:34:40.975858 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 149/307] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:40 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:40.989439 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] validate_networks() for [('862673cc-ea89-444e-b2bd-e75d18a6efab', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:34:41.364463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:34:41.364945 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:34:41.365404 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:34:41.365904 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:34:41.366194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:34:41.375209 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:41.375646 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:41.376457 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:41.376888 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:41.394854 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Getting quotas for project f6a8f13fe22741d6843f193a0a959e57. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:34:41.398751 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Getting quotas for user 09de5ea60b9943adacc765b5ecdccb71 and project f6a8f13fe22741d6843f193a0a959e57. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:34:41.410523 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:34:41.412818 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:34:41.640681 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-48a51a31-47d0-46ee-b4b5-2163aeef4878 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.20 time: 0.766270 Jul 26 16:34:41.641383 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 159/308] 10.222.0.144 () {62 vars in 1193 bytes} [Tue Jul 26 16:34:40 2022] POST /compute/v2.1/servers => generated 403 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 16:34:41.653022 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8f5e39a0-5208-4848-850e-3656e7e1290a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:41.653629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8f5e39a0-5208-4848-850e-3656e7e1290a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:41.708664 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8f5e39a0-5208-4848-850e-3656e7e1290a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:41.715845 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8f5e39a0-5208-4848-850e-3656e7e1290a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:41.717399 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8f5e39a0-5208-4848-850e-3656e7e1290a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:41.718496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8f5e39a0-5208-4848-850e-3656e7e1290a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1285 microversion: 2.20 time: 0.069391 Jul 26 16:34:41.719057 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 150/309] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:41 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1285 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:41.996283 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9a5c411f-9ffa-42cc-835c-0027ee427c79 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:41.996943 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9a5c411f-9ffa-42cc-835c-0027ee427c79 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:42.003139 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9a5c411f-9ffa-42cc-835c-0027ee427c79 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:42.003591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9a5c411f-9ffa-42cc-835c-0027ee427c79 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:42.004354 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9a5c411f-9ffa-42cc-835c-0027ee427c79 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:42.005409 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9a5c411f-9ffa-42cc-835c-0027ee427c79 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:42.141319 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9a5c411f-9ffa-42cc-835c-0027ee427c79 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:42.158943 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9a5c411f-9ffa-42cc-835c-0027ee427c79 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.166506 Jul 26 16:34:42.159513 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 160/310] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:41 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:42.740856 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2acd2067-4023-4d11-bca1-a2df55f5d35c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:42.741449 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2acd2067-4023-4d11-bca1-a2df55f5d35c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:42.793227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2acd2067-4023-4d11-bca1-a2df55f5d35c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:42.800496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2acd2067-4023-4d11-bca1-a2df55f5d35c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:42.802046 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2acd2067-4023-4d11-bca1-a2df55f5d35c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:42.803131 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2acd2067-4023-4d11-bca1-a2df55f5d35c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1285 microversion: 2.20 time: 0.066157 Jul 26 16:34:42.803682 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 151/311] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:42 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1285 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:43.179856 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b3f26b85-fa2b-4324-9b82-e4ffbaae2581 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:43.180596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b3f26b85-fa2b-4324-9b82-e4ffbaae2581 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:43.186708 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3f26b85-fa2b-4324-9b82-e4ffbaae2581 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:43.187167 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3f26b85-fa2b-4324-9b82-e4ffbaae2581 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:43.187929 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3f26b85-fa2b-4324-9b82-e4ffbaae2581 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:43.188365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3f26b85-fa2b-4324-9b82-e4ffbaae2581 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:43.323590 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b3f26b85-fa2b-4324-9b82-e4ffbaae2581 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:43.331160 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b3f26b85-fa2b-4324-9b82-e4ffbaae2581 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.155243 Jul 26 16:34:43.331715 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 161/312] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:43 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:43.824491 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6282a224-6efa-4fd7-9e8d-e7d3e43d8c36 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:43.825020 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6282a224-6efa-4fd7-9e8d-e7d3e43d8c36 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:43.831469 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6282a224-6efa-4fd7-9e8d-e7d3e43d8c36 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:43.831911 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6282a224-6efa-4fd7-9e8d-e7d3e43d8c36 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:43.832691 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6282a224-6efa-4fd7-9e8d-e7d3e43d8c36 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:43.833722 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6282a224-6efa-4fd7-9e8d-e7d3e43d8c36 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:43.851503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:43.901829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6282a224-6efa-4fd7-9e8d-e7d3e43d8c36 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:43.907613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6282a224-6efa-4fd7-9e8d-e7d3e43d8c36 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:43.909157 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6282a224-6efa-4fd7-9e8d-e7d3e43d8c36 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:43.910876 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6282a224-6efa-4fd7-9e8d-e7d3e43d8c36 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1289 microversion: 2.20 time: 0.090301 Jul 26 16:34:43.911812 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 152/313] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:43 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:44.351988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ea87c2bf-9875-4c75-88a4-f6b9e3992b5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:44.352640 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ea87c2bf-9875-4c75-88a4-f6b9e3992b5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:44.359148 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea87c2bf-9875-4c75-88a4-f6b9e3992b5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:44.359613 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea87c2bf-9875-4c75-88a4-f6b9e3992b5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:44.360402 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea87c2bf-9875-4c75-88a4-f6b9e3992b5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:44.360856 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea87c2bf-9875-4c75-88a4-f6b9e3992b5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:44.496059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ea87c2bf-9875-4c75-88a4-f6b9e3992b5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:44.503410 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ea87c2bf-9875-4c75-88a4-f6b9e3992b5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.155307 Jul 26 16:34:44.503962 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 162/314] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:44 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:44.932851 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ff0dc1d5-2832-4218-9f92-601e7f122dee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:44.933463 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ff0dc1d5-2832-4218-9f92-601e7f122dee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:44.935818 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:44.940521 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ff0dc1d5-2832-4218-9f92-601e7f122dee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:44.940973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ff0dc1d5-2832-4218-9f92-601e7f122dee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:44.941735 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ff0dc1d5-2832-4218-9f92-601e7f122dee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:44.942171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ff0dc1d5-2832-4218-9f92-601e7f122dee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:45.000681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ff0dc1d5-2832-4218-9f92-601e7f122dee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:45.008626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ff0dc1d5-2832-4218-9f92-601e7f122dee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:45.010140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ff0dc1d5-2832-4218-9f92-601e7f122dee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:45.011225 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ff0dc1d5-2832-4218-9f92-601e7f122dee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1289 microversion: 2.20 time: 0.082359 Jul 26 16:34:45.011775 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 153/315] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:44 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1289 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:45.525631 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-79e2817e-53f3-4414-af58-1f8e1d1074d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:45.526266 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-79e2817e-53f3-4414-af58-1f8e1d1074d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:45.532599 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79e2817e-53f3-4414-af58-1f8e1d1074d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:45.533046 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79e2817e-53f3-4414-af58-1f8e1d1074d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:45.533799 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79e2817e-53f3-4414-af58-1f8e1d1074d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:45.534224 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79e2817e-53f3-4414-af58-1f8e1d1074d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:45.676458 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-79e2817e-53f3-4414-af58-1f8e1d1074d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:45.684027 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-79e2817e-53f3-4414-af58-1f8e1d1074d0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.162839 Jul 26 16:34:45.684774 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 163/316] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:45 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:46.033453 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-16f527b4-aeb4-40b8-aecc-2906d6774a9c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:46.034063 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-16f527b4-aeb4-40b8-aecc-2906d6774a9c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:46.040541 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-16f527b4-aeb4-40b8-aecc-2906d6774a9c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:46.040996 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-16f527b4-aeb4-40b8-aecc-2906d6774a9c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:46.041761 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-16f527b4-aeb4-40b8-aecc-2906d6774a9c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:46.042197 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-16f527b4-aeb4-40b8-aecc-2906d6774a9c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:46.103495 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-16f527b4-aeb4-40b8-aecc-2906d6774a9c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:46.111447 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-16f527b4-aeb4-40b8-aecc-2906d6774a9c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:46.113015 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-16f527b4-aeb4-40b8-aecc-2906d6774a9c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:46.114114 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-16f527b4-aeb4-40b8-aecc-2906d6774a9c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1281 microversion: 2.20 time: 0.084583 Jul 26 16:34:46.114730 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 154/317] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:46 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:46.705439 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-211baaf9-8879-42b7-a764-6102426df7a2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:46.706042 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-211baaf9-8879-42b7-a764-6102426df7a2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:46.713114 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-211baaf9-8879-42b7-a764-6102426df7a2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:46.713842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-211baaf9-8879-42b7-a764-6102426df7a2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:46.714668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-211baaf9-8879-42b7-a764-6102426df7a2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:46.715930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-211baaf9-8879-42b7-a764-6102426df7a2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:46.845846 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-211baaf9-8879-42b7-a764-6102426df7a2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:46.853413 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-211baaf9-8879-42b7-a764-6102426df7a2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.151963 Jul 26 16:34:46.853966 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 164/318] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:46 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:47.137168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-80e59500-ba35-40b2-be2f-5810c58cbf67 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:47.138142 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-80e59500-ba35-40b2-be2f-5810c58cbf67 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:47.144757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-80e59500-ba35-40b2-be2f-5810c58cbf67 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:47.145200 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-80e59500-ba35-40b2-be2f-5810c58cbf67 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:47.145949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-80e59500-ba35-40b2-be2f-5810c58cbf67 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:47.146377 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-80e59500-ba35-40b2-be2f-5810c58cbf67 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:47.207783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-80e59500-ba35-40b2-be2f-5810c58cbf67 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:47.215626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-80e59500-ba35-40b2-be2f-5810c58cbf67 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:47.217183 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-80e59500-ba35-40b2-be2f-5810c58cbf67 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:47.218257 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-80e59500-ba35-40b2-be2f-5810c58cbf67 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1337 microversion: 2.20 time: 0.084974 Jul 26 16:34:47.218800 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 155/319] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:47 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1337 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:47.874456 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-61550459-6f4a-4ffb-9547-3b84fd8423c2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:47.875116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-61550459-6f4a-4ffb-9547-3b84fd8423c2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:47.881810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61550459-6f4a-4ffb-9547-3b84fd8423c2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:47.882248 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61550459-6f4a-4ffb-9547-3b84fd8423c2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:47.883084 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61550459-6f4a-4ffb-9547-3b84fd8423c2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:47.883515 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61550459-6f4a-4ffb-9547-3b84fd8423c2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:48.030972 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-61550459-6f4a-4ffb-9547-3b84fd8423c2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:48.039777 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-61550459-6f4a-4ffb-9547-3b84fd8423c2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.169122 Jul 26 16:34:48.040549 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 165/320] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:47 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:48.241140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5f23f511-fc50-40f0-8523-cb480c492007 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:48.247252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5f23f511-fc50-40f0-8523-cb480c492007 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:48.247912 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5f23f511-fc50-40f0-8523-cb480c492007 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:48.248352 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5f23f511-fc50-40f0-8523-cb480c492007 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:48.249138 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5f23f511-fc50-40f0-8523-cb480c492007 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:48.249565 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5f23f511-fc50-40f0-8523-cb480c492007 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:48.312630 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5f23f511-fc50-40f0-8523-cb480c492007 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:48.321719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5f23f511-fc50-40f0-8523-cb480c492007 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:48.323611 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5f23f511-fc50-40f0-8523-cb480c492007 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:48.324853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5f23f511-fc50-40f0-8523-cb480c492007 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1337 microversion: 2.20 time: 0.088076 Jul 26 16:34:48.325560 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 156/321] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:48 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1337 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:49.060944 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-88531d40-7e25-4a43-aac5-f86482f7ebf2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:49.061549 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-88531d40-7e25-4a43-aac5-f86482f7ebf2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:49.067606 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-88531d40-7e25-4a43-aac5-f86482f7ebf2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:49.068043 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-88531d40-7e25-4a43-aac5-f86482f7ebf2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:49.068819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-88531d40-7e25-4a43-aac5-f86482f7ebf2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:49.069249 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-88531d40-7e25-4a43-aac5-f86482f7ebf2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:49.199196 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-88531d40-7e25-4a43-aac5-f86482f7ebf2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:49.206645 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-88531d40-7e25-4a43-aac5-f86482f7ebf2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.149701 Jul 26 16:34:49.207149 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 166/322] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:49 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:49.348059 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b58c1271-d82c-429f-9139-e02bbcfcff53 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:49.348694 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b58c1271-d82c-429f-9139-e02bbcfcff53 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:49.355738 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b58c1271-d82c-429f-9139-e02bbcfcff53 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:49.356186 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b58c1271-d82c-429f-9139-e02bbcfcff53 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:49.356977 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b58c1271-d82c-429f-9139-e02bbcfcff53 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:49.357410 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b58c1271-d82c-429f-9139-e02bbcfcff53 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:49.420033 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b58c1271-d82c-429f-9139-e02bbcfcff53 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:49.427966 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b58c1271-d82c-429f-9139-e02bbcfcff53 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:49.430148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b58c1271-d82c-429f-9139-e02bbcfcff53 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:49.431232 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b58c1271-d82c-429f-9139-e02bbcfcff53 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1337 microversion: 2.20 time: 0.087436 Jul 26 16:34:49.431786 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 157/323] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:49 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1337 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:50.227221 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-817f45de-3b31-48b4-bf69-38177f7b60e7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:50.227819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-817f45de-3b31-48b4-bf69-38177f7b60e7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:50.236098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-817f45de-3b31-48b4-bf69-38177f7b60e7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:50.236098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-817f45de-3b31-48b4-bf69-38177f7b60e7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:50.236098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-817f45de-3b31-48b4-bf69-38177f7b60e7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:50.236098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-817f45de-3b31-48b4-bf69-38177f7b60e7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:50.364350 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-817f45de-3b31-48b4-bf69-38177f7b60e7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:50.371824 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-817f45de-3b31-48b4-bf69-38177f7b60e7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.148474 Jul 26 16:34:50.372375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 167/324] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:50 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:50.453638 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a9ea2607-6cd9-4787-9765-7485965d031f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:50.454237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a9ea2607-6cd9-4787-9765-7485965d031f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:50.461215 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a9ea2607-6cd9-4787-9765-7485965d031f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:50.461636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a9ea2607-6cd9-4787-9765-7485965d031f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:50.462383 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a9ea2607-6cd9-4787-9765-7485965d031f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:50.462888 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a9ea2607-6cd9-4787-9765-7485965d031f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:50.526040 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a9ea2607-6cd9-4787-9765-7485965d031f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:50.534469 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a9ea2607-6cd9-4787-9765-7485965d031f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:50.536092 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a9ea2607-6cd9-4787-9765-7485965d031f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:50.537255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a9ea2607-6cd9-4787-9765-7485965d031f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1337 microversion: 2.20 time: 0.087577 Jul 26 16:34:50.537803 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 158/325] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:50 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1337 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:51.394578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2eff2644-80a4-416f-9394-991c2e84fdda tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:51.395181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2eff2644-80a4-416f-9394-991c2e84fdda tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:51.397522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:51.402455 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2eff2644-80a4-416f-9394-991c2e84fdda tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:51.402900 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2eff2644-80a4-416f-9394-991c2e84fdda tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:51.403657 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2eff2644-80a4-416f-9394-991c2e84fdda tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:51.404088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2eff2644-80a4-416f-9394-991c2e84fdda tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:51.408023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=6 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:51.538349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2eff2644-80a4-416f-9394-991c2e84fdda tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:51.546983 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2eff2644-80a4-416f-9394-991c2e84fdda tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1505 microversion: 2.1 time: 0.156686 Jul 26 16:34:51.547568 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 168/326] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:51 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:51.560836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-73e3c991-21a9-4cc7-a1a7-8da2188a7b6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:51.561454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-73e3c991-21a9-4cc7-a1a7-8da2188a7b6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:51.567320 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7f6ee376-2987-4627-a29e-e2a8cedc6857 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "104a617b-9414-41c1-832d-21fd0b4fad89"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:34:51.569658 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-73e3c991-21a9-4cc7-a1a7-8da2188a7b6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:51.569805 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7f6ee376-2987-4627-a29e-e2a8cedc6857 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:51.570119 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-73e3c991-21a9-4cc7-a1a7-8da2188a7b6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:51.571123 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-73e3c991-21a9-4cc7-a1a7-8da2188a7b6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:51.571561 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-73e3c991-21a9-4cc7-a1a7-8da2188a7b6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:51.575887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f6ee376-2987-4627-a29e-e2a8cedc6857 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:51.576340 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f6ee376-2987-4627-a29e-e2a8cedc6857 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:51.577130 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f6ee376-2987-4627-a29e-e2a8cedc6857 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:51.577556 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f6ee376-2987-4627-a29e-e2a8cedc6857 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:51.765938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-7f6ee376-2987-4627-a29e-e2a8cedc6857 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] HTTP exception thrown: Cannot 'attach_volume' instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 while it is in vm_state rescued Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7f6ee376-2987-4627-a29e-e2a8cedc6857 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Request method failure captured: Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: POST /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64/os-volume_attachments HTTP/1.1 Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 74 Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BcttderPmzD14SOzevUatQn_f-KHC5OwGIojgRdyaUAc4Q1splEtFnf0Amz--8kn0btqR7qNv-Oau7NZOr9CIrJ1ECpBFaPA389wG3XOEox8RN_ElBs6FWCM-M77RP2f4-NCuQPVbu8Asiz1iIG5mD8gksIoGny2uALegpP_gIpua4 Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 08a954085f8f454698c55faa9351ad6e Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:34:51.771828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_08a954085f8f454698c55faa9351ad6e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 08a954085f8f454698c55faa9351ad6e Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-ServerRescueNegativeTestJSON-450575223-project Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 07e70b1c968443eab469777283b8fb50 Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-ServerRescueNegativeTestJSON-450575223-project Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {"volumeAttachment": {"volumeId": "104a617b-9414-41c1-832d-21fd0b4fad89"}} Jul 26 16:34:51.773981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Cannot 'attach_volume' instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 while it is in vm_state rescued Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'server_id': 'fad766a1-6214-4f3a-aa55-50ca2baa6b64', 'body': {'volumeAttachment': {'volumeId': '104a617b-9414-41c1-832d-21fd0b4fad89'}}} Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:34:51.774891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 while it is in vm_state rescued Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:34:51.777012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:34:51.778803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:34:51.778803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:34:51.778803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 while it is in vm_state rescued Jul 26 16:34:51.778803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:34:51.778803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7f6ee376-2987-4627-a29e-e2a8cedc6857 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Returning 409 to user: Cannot 'attach_volume' instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 while it is in vm_state rescued {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:34:51.778803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7f6ee376-2987-4627-a29e-e2a8cedc6857 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.206011 Jul 26 16:34:51.778803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 169/327] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:34:51 2022] POST /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64/os-volume_attachments => generated 152 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 16:34:51.784093 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-05769c48-4092-4626-82fb-d375953db3ff tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:34:51.784093 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-05769c48-4092-4626-82fb-d375953db3ff tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:51.788026 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-05769c48-4092-4626-82fb-d375953db3ff tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:51.788496 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-05769c48-4092-4626-82fb-d375953db3ff tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:51.789272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-05769c48-4092-4626-82fb-d375953db3ff tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:51.789722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-05769c48-4092-4626-82fb-d375953db3ff tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:51.924135 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-73e3c991-21a9-4cc7-a1a7-8da2188a7b6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:51.933041 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-73e3c991-21a9-4cc7-a1a7-8da2188a7b6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:51.934940 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-73e3c991-21a9-4cc7-a1a7-8da2188a7b6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:51.936161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-73e3c991-21a9-4cc7-a1a7-8da2188a7b6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1345 microversion: 2.20 time: 0.380289 Jul 26 16:34:51.943625 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 159/328] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:51 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1345 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:52.161915 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-05769c48-4092-4626-82fb-d375953db3ff tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64/action" status: 202 len: 0 microversion: 2.1 time: 0.386109 Jul 26 16:34:52.162632 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 170/329] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:34:51 2022] POST /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64/action => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:34:52.172801 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-32089b2b-6639-4ff6-b68e-638835fe0086 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:52.173690 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-32089b2b-6639-4ff6-b68e-638835fe0086 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:52.180220 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32089b2b-6639-4ff6-b68e-638835fe0086 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:52.180686 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32089b2b-6639-4ff6-b68e-638835fe0086 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:52.181445 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32089b2b-6639-4ff6-b68e-638835fe0086 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:52.181871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32089b2b-6639-4ff6-b68e-638835fe0086 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:52.380566 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-32089b2b-6639-4ff6-b68e-638835fe0086 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:52.389005 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-32089b2b-6639-4ff6-b68e-638835fe0086 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.221368 Jul 26 16:34:52.389719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 160/330] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:52 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:34:52.952005 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1172439243", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:34:52.966312 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7d05febe-920d-4fd2-938c-8b8d0fa64f68 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:52.966916 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7d05febe-920d-4fd2-938c-8b8d0fa64f68 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:52.969281 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=8 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:52.977404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d05febe-920d-4fd2-938c-8b8d0fa64f68 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:52.979831 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d05febe-920d-4fd2-938c-8b8d0fa64f68 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:52.979831 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d05febe-920d-4fd2-938c-8b8d0fa64f68 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:52.979831 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d05febe-920d-4fd2-938c-8b8d0fa64f68 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:53.040288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] validate_networks() for None {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:34:53.161252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7d05febe-920d-4fd2-938c-8b8d0fa64f68 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:53.169391 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7d05febe-920d-4fd2-938c-8b8d0fa64f68 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:53.170937 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7d05febe-920d-4fd2-938c-8b8d0fa64f68 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:53.174451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7d05febe-920d-4fd2-938c-8b8d0fa64f68 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.209637 Jul 26 16:34:53.174451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 161/331] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:52 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:53.337503 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:34:53.337929 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:34:53.338432 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:34:53.338843 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:34:53.339253 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:34:53.348252 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:53.348723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:53.349514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:53.349945 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:53.366108 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Getting quotas for project fcbae11ef93f4951a3bc244ef9fd7a05. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:34:53.369983 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Getting quotas for user 75c919b5c8624a2ebad5bff722a3ff11 and project fcbae11ef93f4951a3bc244ef9fd7a05. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:34:53.381774 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:34:53.384171 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:34:53.410294 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e04ff68c-981c-481e-a886-6fe0ff7b61c6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:53.410905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e04ff68c-981c-481e-a886-6fe0ff7b61c6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:53.416853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e04ff68c-981c-481e-a886-6fe0ff7b61c6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:53.417304 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e04ff68c-981c-481e-a886-6fe0ff7b61c6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:53.418064 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e04ff68c-981c-481e-a886-6fe0ff7b61c6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:53.418497 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e04ff68c-981c-481e-a886-6fe0ff7b61c6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:53.548636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e04ff68c-981c-481e-a886-6fe0ff7b61c6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:53.556665 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e04ff68c-981c-481e-a886-6fe0ff7b61c6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.150127 Jul 26 16:34:53.557220 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 162/332] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:53 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:34:53.639474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e47ebcae-45ca-4d74-8f60-f136d1bb542a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.691947 Jul 26 16:34:53.640105 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 171/333] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:34:52 2022] POST /compute/v2.1/servers => generated 382 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:34:53.651182 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3733812d-9f17-4359-99c8-1f59cb3076f7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:53.651783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3733812d-9f17-4359-99c8-1f59cb3076f7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:53.705125 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3733812d-9f17-4359-99c8-1f59cb3076f7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:53.711779 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3733812d-9f17-4359-99c8-1f59cb3076f7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1219 microversion: 2.1 time: 0.064648 Jul 26 16:34:53.712346 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 163/334] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:53 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:54.194427 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e5828265-5ce3-4230-9439-7eca2e9ee6c8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:54.195047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e5828265-5ce3-4230-9439-7eca2e9ee6c8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:54.201285 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5828265-5ce3-4230-9439-7eca2e9ee6c8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:54.201734 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5828265-5ce3-4230-9439-7eca2e9ee6c8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:54.202493 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5828265-5ce3-4230-9439-7eca2e9ee6c8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:54.203139 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5828265-5ce3-4230-9439-7eca2e9ee6c8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:54.338100 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e5828265-5ce3-4230-9439-7eca2e9ee6c8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:54.346183 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e5828265-5ce3-4230-9439-7eca2e9ee6c8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:54.347683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e5828265-5ce3-4230-9439-7eca2e9ee6c8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:54.348798 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e5828265-5ce3-4230-9439-7eca2e9ee6c8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.158816 Jul 26 16:34:54.349344 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 172/335] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:54 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:54.578243 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3576ce6b-ac09-48ef-9f02-f46dbf1cb620 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:54.579101 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3576ce6b-ac09-48ef-9f02-f46dbf1cb620 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:54.585531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3576ce6b-ac09-48ef-9f02-f46dbf1cb620 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:54.596671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3576ce6b-ac09-48ef-9f02-f46dbf1cb620 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:54.596671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3576ce6b-ac09-48ef-9f02-f46dbf1cb620 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:54.596671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3576ce6b-ac09-48ef-9f02-f46dbf1cb620 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:54.721772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3576ce6b-ac09-48ef-9f02-f46dbf1cb620 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:54.732760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e7d6b0a0-bfeb-4a82-ab89-00540aa728f3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:54.733258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e7d6b0a0-bfeb-4a82-ab89-00540aa728f3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:54.733421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3576ce6b-ac09-48ef-9f02-f46dbf1cb620 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.158501 Jul 26 16:34:54.733846 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 164/336] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:54 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:54.784049 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e7d6b0a0-bfeb-4a82-ab89-00540aa728f3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:54.791374 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e7d6b0a0-bfeb-4a82-ab89-00540aa728f3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1219 microversion: 2.1 time: 0.062606 Jul 26 16:34:54.791929 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 173/337] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:54 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1219 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:34:55.371470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-afbe08e4-de58-4cba-b2ee-b8e3ccf1ade8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:55.372077 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-afbe08e4-de58-4cba-b2ee-b8e3ccf1ade8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:55.378229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-afbe08e4-de58-4cba-b2ee-b8e3ccf1ade8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:55.378666 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-afbe08e4-de58-4cba-b2ee-b8e3ccf1ade8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:55.379472 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-afbe08e4-de58-4cba-b2ee-b8e3ccf1ade8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:55.379904 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-afbe08e4-de58-4cba-b2ee-b8e3ccf1ade8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:55.522565 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-afbe08e4-de58-4cba-b2ee-b8e3ccf1ade8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:55.529661 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-afbe08e4-de58-4cba-b2ee-b8e3ccf1ade8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:55.531158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-afbe08e4-de58-4cba-b2ee-b8e3ccf1ade8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:55.532258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-afbe08e4-de58-4cba-b2ee-b8e3ccf1ade8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.164768 Jul 26 16:34:55.532837 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 165/338] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:55 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:55.755248 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e05b6702-6bc5-4d08-bd5b-648184e07d3b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:55.755923 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e05b6702-6bc5-4d08-bd5b-648184e07d3b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:55.761948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e05b6702-6bc5-4d08-bd5b-648184e07d3b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:55.762431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e05b6702-6bc5-4d08-bd5b-648184e07d3b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:55.763188 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e05b6702-6bc5-4d08-bd5b-648184e07d3b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:55.763619 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e05b6702-6bc5-4d08-bd5b-648184e07d3b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:55.812620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-74902350-e8f2-4b4e-88ba-6984847579e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:55.813205 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-74902350-e8f2-4b4e-88ba-6984847579e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:55.819639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-74902350-e8f2-4b4e-88ba-6984847579e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:55.820088 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-74902350-e8f2-4b4e-88ba-6984847579e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:55.820899 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-74902350-e8f2-4b4e-88ba-6984847579e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:55.821333 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-74902350-e8f2-4b4e-88ba-6984847579e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:55.883240 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-74902350-e8f2-4b4e-88ba-6984847579e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:55.890408 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-74902350-e8f2-4b4e-88ba-6984847579e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1223 microversion: 2.1 time: 0.081502 Jul 26 16:34:55.890904 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 166/339] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:55 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:34:55.898969 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e05b6702-6bc5-4d08-bd5b-648184e07d3b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:55.906595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e05b6702-6bc5-4d08-bd5b-648184e07d3b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.155410 Jul 26 16:34:55.907123 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 174/340] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:55 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:56.555485 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3f74beb3-7eca-4caa-9275-80f2f9e1e5b7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:56.556095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3f74beb3-7eca-4caa-9275-80f2f9e1e5b7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:56.562200 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f74beb3-7eca-4caa-9275-80f2f9e1e5b7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:56.562651 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f74beb3-7eca-4caa-9275-80f2f9e1e5b7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:56.563410 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f74beb3-7eca-4caa-9275-80f2f9e1e5b7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:56.563840 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f74beb3-7eca-4caa-9275-80f2f9e1e5b7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:56.699648 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3f74beb3-7eca-4caa-9275-80f2f9e1e5b7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:56.707656 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3f74beb3-7eca-4caa-9275-80f2f9e1e5b7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:56.709213 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3f74beb3-7eca-4caa-9275-80f2f9e1e5b7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:56.710307 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3f74beb3-7eca-4caa-9275-80f2f9e1e5b7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.159245 Jul 26 16:34:56.710856 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 167/341] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:56 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:56.911910 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c2e40603-8d98-42f3-8d45-e6dcfaf69040 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:56.912544 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c2e40603-8d98-42f3-8d45-e6dcfaf69040 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:56.919047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c2e40603-8d98-42f3-8d45-e6dcfaf69040 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:56.919480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c2e40603-8d98-42f3-8d45-e6dcfaf69040 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:56.920233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c2e40603-8d98-42f3-8d45-e6dcfaf69040 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:56.920690 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c2e40603-8d98-42f3-8d45-e6dcfaf69040 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:56.929663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-51bc0d94-96ef-4eb0-b995-d33a3ffe4bfb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:56.930330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-51bc0d94-96ef-4eb0-b995-d33a3ffe4bfb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:56.937070 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51bc0d94-96ef-4eb0-b995-d33a3ffe4bfb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:56.937521 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51bc0d94-96ef-4eb0-b995-d33a3ffe4bfb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:56.938310 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51bc0d94-96ef-4eb0-b995-d33a3ffe4bfb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:56.938733 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51bc0d94-96ef-4eb0-b995-d33a3ffe4bfb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:56.940895 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:56.984290 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c2e40603-8d98-42f3-8d45-e6dcfaf69040 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:56.992764 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c2e40603-8d98-42f3-8d45-e6dcfaf69040 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1223 microversion: 2.1 time: 0.084653 Jul 26 16:34:56.995933 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 175/342] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:56 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:57.072834 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-51bc0d94-96ef-4eb0-b995-d33a3ffe4bfb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:57.080770 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-51bc0d94-96ef-4eb0-b995-d33a3ffe4bfb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.155637 Jul 26 16:34:57.081328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 168/343] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:56 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:57.732753 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-bd90e6da-31b1-49e0-b9e3-e4af62f1c4a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:57.733611 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-bd90e6da-31b1-49e0-b9e3-e4af62f1c4a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:57.742521 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd90e6da-31b1-49e0-b9e3-e4af62f1c4a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:57.743145 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd90e6da-31b1-49e0-b9e3-e4af62f1c4a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:57.744110 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd90e6da-31b1-49e0-b9e3-e4af62f1c4a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:57.744730 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd90e6da-31b1-49e0-b9e3-e4af62f1c4a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:57.899825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-bd90e6da-31b1-49e0-b9e3-e4af62f1c4a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:57.907867 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-bd90e6da-31b1-49e0-b9e3-e4af62f1c4a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:57.909557 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-bd90e6da-31b1-49e0-b9e3-e4af62f1c4a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:57.910665 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-bd90e6da-31b1-49e0-b9e3-e4af62f1c4a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.182014 Jul 26 16:34:57.911218 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 176/344] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:57 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:58.014382 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-467fbeca-ef32-4560-aa9d-8009767859c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:58.015176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-467fbeca-ef32-4560-aa9d-8009767859c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:58.022328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-467fbeca-ef32-4560-aa9d-8009767859c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:58.022750 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-467fbeca-ef32-4560-aa9d-8009767859c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:58.024693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-467fbeca-ef32-4560-aa9d-8009767859c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:58.024693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-467fbeca-ef32-4560-aa9d-8009767859c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:58.076929 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-a77b146b-38ee-4731-8e6b-157b2079f2b1 req-62f4ca64-7129-4502-a500-2f292e7b97a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d182cbe3-dff4-482c-a901-f084fc7b0077", "tag": "7f871a00-9630-48c9-845a-ddb06fb9a2df"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:34:58.092333 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-a77b146b-38ee-4731-8e6b-157b2079f2b1 req-62f4ca64-7129-4502-a500-2f292e7b97a2 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:58.092333 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-a77b146b-38ee-4731-8e6b-157b2079f2b1 req-62f4ca64-7129-4502-a500-2f292e7b97a2 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:58.101086 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-a77b146b-38ee-4731-8e6b-157b2079f2b1 req-62f4ca64-7129-4502-a500-2f292e7b97a2 service nova] Creating event network-changed:7f871a00-9630-48c9-845a-ddb06fb9a2df for instance d182cbe3-dff4-482c-a901-f084fc7b0077 on hv-cinder-85104 Jul 26 16:34:58.106334 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-a77b146b-38ee-4731-8e6b-157b2079f2b1 req-62f4ca64-7129-4502-a500-2f292e7b97a2 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033735 Jul 26 16:34:58.106997 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 177/345] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:34:58.112807 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4fb9e6bb-c248-4c6d-82be-37ac1a608fe8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:58.113792 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4fb9e6bb-c248-4c6d-82be-37ac1a608fe8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:58.120952 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4fb9e6bb-c248-4c6d-82be-37ac1a608fe8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:58.121659 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4fb9e6bb-c248-4c6d-82be-37ac1a608fe8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:58.123371 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4fb9e6bb-c248-4c6d-82be-37ac1a608fe8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:58.124151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4fb9e6bb-c248-4c6d-82be-37ac1a608fe8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:58.125248 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-467fbeca-ef32-4560-aa9d-8009767859c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:58.136988 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-467fbeca-ef32-4560-aa9d-8009767859c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1223 microversion: 2.1 time: 0.125730 Jul 26 16:34:58.144523 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 169/346] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:58 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1223 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:58.278066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4fb9e6bb-c248-4c6d-82be-37ac1a608fe8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:58.285500 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4fb9e6bb-c248-4c6d-82be-37ac1a608fe8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.177175 Jul 26 16:34:58.286057 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 178/347] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:58 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:58.932326 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-30f49663-6736-4f12-b5ad-2eab1b2cb483 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:58.932911 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-30f49663-6736-4f12-b5ad-2eab1b2cb483 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:58.938883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-30f49663-6736-4f12-b5ad-2eab1b2cb483 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:58.939325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-30f49663-6736-4f12-b5ad-2eab1b2cb483 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:58.940100 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-30f49663-6736-4f12-b5ad-2eab1b2cb483 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:58.940557 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-30f49663-6736-4f12-b5ad-2eab1b2cb483 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:58.944350 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:34:59.072730 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-30f49663-6736-4f12-b5ad-2eab1b2cb483 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:59.082660 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-30f49663-6736-4f12-b5ad-2eab1b2cb483 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:59.084476 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-30f49663-6736-4f12-b5ad-2eab1b2cb483 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:59.086228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-30f49663-6736-4f12-b5ad-2eab1b2cb483 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.157776 Jul 26 16:34:59.086791 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 170/348] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:34:58 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:34:59.164843 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e5e9ecd0-80e6-4c0c-b135-b056fff9d788 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:59.165459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e5e9ecd0-80e6-4c0c-b135-b056fff9d788 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:59.173062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5e9ecd0-80e6-4c0c-b135-b056fff9d788 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:59.173512 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5e9ecd0-80e6-4c0c-b135-b056fff9d788 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:59.174278 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5e9ecd0-80e6-4c0c-b135-b056fff9d788 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:59.174711 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e5e9ecd0-80e6-4c0c-b135-b056fff9d788 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:59.250648 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e5e9ecd0-80e6-4c0c-b135-b056fff9d788 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:59.250648 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e5e9ecd0-80e6-4c0c-b135-b056fff9d788 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1223 microversion: 2.1 time: 0.088994 Jul 26 16:34:59.250648 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 179/349] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:59 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:34:59.306517 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b10c079a-940d-46c9-96e4-8d6ca186be8b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:34:59.307126 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b10c079a-940d-46c9-96e4-8d6ca186be8b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:34:59.313106 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b10c079a-940d-46c9-96e4-8d6ca186be8b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:59.313563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b10c079a-940d-46c9-96e4-8d6ca186be8b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:59.314320 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b10c079a-940d-46c9-96e4-8d6ca186be8b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:34:59.314756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b10c079a-940d-46c9-96e4-8d6ca186be8b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:34:59.557201 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b10c079a-940d-46c9-96e4-8d6ca186be8b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:34:59.565061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b10c079a-940d-46c9-96e4-8d6ca186be8b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.262479 Jul 26 16:34:59.565960 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 171/350] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:34:59 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:00.109233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-64c1108c-619b-4bfe-b8b3-2c17fbf7d666 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:00.109931 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-64c1108c-619b-4bfe-b8b3-2c17fbf7d666 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:00.115923 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64c1108c-619b-4bfe-b8b3-2c17fbf7d666 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:00.117036 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64c1108c-619b-4bfe-b8b3-2c17fbf7d666 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:00.117804 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64c1108c-619b-4bfe-b8b3-2c17fbf7d666 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:00.118238 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64c1108c-619b-4bfe-b8b3-2c17fbf7d666 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:00.250216 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-64c1108c-619b-4bfe-b8b3-2c17fbf7d666 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:00.259101 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-64c1108c-619b-4bfe-b8b3-2c17fbf7d666 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:00.260880 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-64c1108c-619b-4bfe-b8b3-2c17fbf7d666 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:00.262022 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-64c1108c-619b-4bfe-b8b3-2c17fbf7d666 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.156642 Jul 26 16:35:00.262802 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 180/351] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:00 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:35:00.271583 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-804a913c-7868-45cb-8095-f95d61858bd9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:00.273010 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-804a913c-7868-45cb-8095-f95d61858bd9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:00.279487 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-804a913c-7868-45cb-8095-f95d61858bd9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:00.279932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-804a913c-7868-45cb-8095-f95d61858bd9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:00.280721 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-804a913c-7868-45cb-8095-f95d61858bd9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:00.281255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-804a913c-7868-45cb-8095-f95d61858bd9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:00.343930 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-804a913c-7868-45cb-8095-f95d61858bd9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:00.351968 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-804a913c-7868-45cb-8095-f95d61858bd9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1271 microversion: 2.1 time: 0.084876 Jul 26 16:35:00.352548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 172/352] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:00 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:00.587378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b1d5079a-87f0-4604-ba7a-b88811a62eb4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:00.588036 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b1d5079a-87f0-4604-ba7a-b88811a62eb4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:00.594764 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b1d5079a-87f0-4604-ba7a-b88811a62eb4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:00.595218 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b1d5079a-87f0-4604-ba7a-b88811a62eb4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:00.595998 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b1d5079a-87f0-4604-ba7a-b88811a62eb4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:00.596524 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b1d5079a-87f0-4604-ba7a-b88811a62eb4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:00.735578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b1d5079a-87f0-4604-ba7a-b88811a62eb4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:00.743193 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b1d5079a-87f0-4604-ba7a-b88811a62eb4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.160161 Jul 26 16:35:00.743761 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 181/353] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:00 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:01.285007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3abcf6c3-d45e-4f60-a5d7-7ffb5b68a318 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:01.285637 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3abcf6c3-d45e-4f60-a5d7-7ffb5b68a318 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:01.292776 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3abcf6c3-d45e-4f60-a5d7-7ffb5b68a318 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:01.293222 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3abcf6c3-d45e-4f60-a5d7-7ffb5b68a318 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:01.294008 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3abcf6c3-d45e-4f60-a5d7-7ffb5b68a318 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:01.294442 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3abcf6c3-d45e-4f60-a5d7-7ffb5b68a318 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:01.372804 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dccea2d8-7e7d-4282-ab3e-1c6eaeeef8ea tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:01.373710 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dccea2d8-7e7d-4282-ab3e-1c6eaeeef8ea tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:01.379702 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dccea2d8-7e7d-4282-ab3e-1c6eaeeef8ea tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:01.380145 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dccea2d8-7e7d-4282-ab3e-1c6eaeeef8ea tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:01.380941 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dccea2d8-7e7d-4282-ab3e-1c6eaeeef8ea tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:01.384945 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dccea2d8-7e7d-4282-ab3e-1c6eaeeef8ea tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:01.435312 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3abcf6c3-d45e-4f60-a5d7-7ffb5b68a318 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:01.442156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-dccea2d8-7e7d-4282-ab3e-1c6eaeeef8ea tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:01.443677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3abcf6c3-d45e-4f60-a5d7-7ffb5b68a318 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:01.445729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3abcf6c3-d45e-4f60-a5d7-7ffb5b68a318 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:01.446876 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3abcf6c3-d45e-4f60-a5d7-7ffb5b68a318 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.165761 Jul 26 16:35:01.447429 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 173/354] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:01 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:35:01.450538 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dccea2d8-7e7d-4282-ab3e-1c6eaeeef8ea tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1271 microversion: 2.1 time: 0.081784 Jul 26 16:35:01.453602 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 182/355] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:01 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:01.765236 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2177ce1f-7493-4475-99ba-c0b52714367d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:01.765847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2177ce1f-7493-4475-99ba-c0b52714367d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:01.773520 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2177ce1f-7493-4475-99ba-c0b52714367d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:01.773968 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2177ce1f-7493-4475-99ba-c0b52714367d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:01.774735 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2177ce1f-7493-4475-99ba-c0b52714367d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:01.775163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2177ce1f-7493-4475-99ba-c0b52714367d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:01.912232 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2177ce1f-7493-4475-99ba-c0b52714367d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:01.919797 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2177ce1f-7493-4475-99ba-c0b52714367d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.158456 Jul 26 16:35:01.920350 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 174/356] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:01 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:02.470860 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-673d78ec-5559-425e-9528-f37daa089331 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:02.472215 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-673d78ec-5559-425e-9528-f37daa089331 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:02.475038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a498b4b4-35b1-4750-a8ad-5ed2352a08c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:02.475881 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a498b4b4-35b1-4750-a8ad-5ed2352a08c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:02.479645 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-673d78ec-5559-425e-9528-f37daa089331 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:02.480185 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-673d78ec-5559-425e-9528-f37daa089331 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:02.481075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-673d78ec-5559-425e-9528-f37daa089331 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:02.481517 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-673d78ec-5559-425e-9528-f37daa089331 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:02.482675 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a498b4b4-35b1-4750-a8ad-5ed2352a08c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:02.483127 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a498b4b4-35b1-4750-a8ad-5ed2352a08c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:02.483906 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a498b4b4-35b1-4750-a8ad-5ed2352a08c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:02.484341 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a498b4b4-35b1-4750-a8ad-5ed2352a08c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:02.644378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-673d78ec-5559-425e-9528-f37daa089331 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:02.653197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-673d78ec-5559-425e-9528-f37daa089331 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:02.654738 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-673d78ec-5559-425e-9528-f37daa089331 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:02.655833 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-673d78ec-5559-425e-9528-f37daa089331 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.189335 Jul 26 16:35:02.656418 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 183/357] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:02 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:35:02.683086 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a498b4b4-35b1-4750-a8ad-5ed2352a08c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:02.690848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a498b4b4-35b1-4750-a8ad-5ed2352a08c6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1271 microversion: 2.1 time: 0.219343 Jul 26 16:35:02.691417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 175/358] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:02 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1271 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:02.941937 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4d5954f7-e18c-412f-a76b-8a99250f41fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:02.942455 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4d5954f7-e18c-412f-a76b-8a99250f41fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:02.949739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d5954f7-e18c-412f-a76b-8a99250f41fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:02.950194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d5954f7-e18c-412f-a76b-8a99250f41fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:02.950975 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d5954f7-e18c-412f-a76b-8a99250f41fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:02.951435 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d5954f7-e18c-412f-a76b-8a99250f41fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:03.081751 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4d5954f7-e18c-412f-a76b-8a99250f41fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:03.089919 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4d5954f7-e18c-412f-a76b-8a99250f41fb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.151967 Jul 26 16:35:03.090492 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 184/359] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:02 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:03.679614 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9e1c5362-cf58-45b2-abf8-63c78279c38e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:03.680265 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9e1c5362-cf58-45b2-abf8-63c78279c38e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:03.686809 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e1c5362-cf58-45b2-abf8-63c78279c38e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:03.687253 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e1c5362-cf58-45b2-abf8-63c78279c38e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:03.688008 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e1c5362-cf58-45b2-abf8-63c78279c38e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:03.688464 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e1c5362-cf58-45b2-abf8-63c78279c38e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:03.709559 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:03.712822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dafaad17-42cb-47ba-870f-5170dde17704 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:03.713438 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dafaad17-42cb-47ba-870f-5170dde17704 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:03.715549 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:03.720611 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dafaad17-42cb-47ba-870f-5170dde17704 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:03.721078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dafaad17-42cb-47ba-870f-5170dde17704 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:03.721856 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dafaad17-42cb-47ba-870f-5170dde17704 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:03.722293 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dafaad17-42cb-47ba-870f-5170dde17704 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:03.786527 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-dafaad17-42cb-47ba-870f-5170dde17704 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:03.795201 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dafaad17-42cb-47ba-870f-5170dde17704 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1271 microversion: 2.1 time: 0.086375 Jul 26 16:35:03.795757 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 185/360] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:03 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:03.835978 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9e1c5362-cf58-45b2-abf8-63c78279c38e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:03.844511 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9e1c5362-cf58-45b2-abf8-63c78279c38e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:03.846043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9e1c5362-cf58-45b2-abf8-63c78279c38e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:03.847149 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9e1c5362-cf58-45b2-abf8-63c78279c38e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.172091 Jul 26 16:35:03.847699 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 176/361] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:03 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:35:04.110579 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ec4f4bd8-4b0f-45ba-ae7b-6feadf9e8f42 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:04.111182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ec4f4bd8-4b0f-45ba-ae7b-6feadf9e8f42 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:04.117171 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec4f4bd8-4b0f-45ba-ae7b-6feadf9e8f42 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:04.117645 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec4f4bd8-4b0f-45ba-ae7b-6feadf9e8f42 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:04.118408 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec4f4bd8-4b0f-45ba-ae7b-6feadf9e8f42 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:04.118840 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec4f4bd8-4b0f-45ba-ae7b-6feadf9e8f42 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:04.246857 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ec4f4bd8-4b0f-45ba-ae7b-6feadf9e8f42 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:04.254438 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ec4f4bd8-4b0f-45ba-ae7b-6feadf9e8f42 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.147641 Jul 26 16:35:04.255027 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 186/362] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:04 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:04.816544 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-414a41eb-72a1-44f5-a814-5a904a7ae9cc tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:04.817152 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-414a41eb-72a1-44f5-a814-5a904a7ae9cc tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:04.824356 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-414a41eb-72a1-44f5-a814-5a904a7ae9cc tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:04.824828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-414a41eb-72a1-44f5-a814-5a904a7ae9cc tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:04.825587 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-414a41eb-72a1-44f5-a814-5a904a7ae9cc tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:04.826016 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-414a41eb-72a1-44f5-a814-5a904a7ae9cc tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:04.870116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b794b6e4-7f92-4abf-b493-4a991635e0cb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:04.870724 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b794b6e4-7f92-4abf-b493-4a991635e0cb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:04.872884 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=8 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:04.877986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b794b6e4-7f92-4abf-b493-4a991635e0cb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:04.882552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b794b6e4-7f92-4abf-b493-4a991635e0cb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:04.882552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b794b6e4-7f92-4abf-b493-4a991635e0cb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:04.882552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b794b6e4-7f92-4abf-b493-4a991635e0cb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:04.886910 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-414a41eb-72a1-44f5-a814-5a904a7ae9cc tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:04.894584 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-414a41eb-72a1-44f5-a814-5a904a7ae9cc tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1271 microversion: 2.1 time: 0.082266 Jul 26 16:35:04.895150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 177/363] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:04 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:05.006194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b794b6e4-7f92-4abf-b493-4a991635e0cb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:05.014707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b794b6e4-7f92-4abf-b493-4a991635e0cb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:05.016210 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b794b6e4-7f92-4abf-b493-4a991635e0cb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:05.017337 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b794b6e4-7f92-4abf-b493-4a991635e0cb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.151836 Jul 26 16:35:05.018153 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 187/364] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:04 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:35:05.276413 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b63955f6-1e02-4a04-b1f5-b8f40eac1af9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:05.277026 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b63955f6-1e02-4a04-b1f5-b8f40eac1af9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:05.282975 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b63955f6-1e02-4a04-b1f5-b8f40eac1af9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:05.283421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b63955f6-1e02-4a04-b1f5-b8f40eac1af9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:05.284247 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b63955f6-1e02-4a04-b1f5-b8f40eac1af9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:05.284706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b63955f6-1e02-4a04-b1f5-b8f40eac1af9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:05.414772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b63955f6-1e02-4a04-b1f5-b8f40eac1af9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:05.422200 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b63955f6-1e02-4a04-b1f5-b8f40eac1af9 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.149870 Jul 26 16:35:05.422752 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 178/365] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:05 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:05.916575 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fb367a47-2c4a-4309-b04a-7a3cef563c73 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:05.917190 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fb367a47-2c4a-4309-b04a-7a3cef563c73 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:05.923237 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fb367a47-2c4a-4309-b04a-7a3cef563c73 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:05.923686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fb367a47-2c4a-4309-b04a-7a3cef563c73 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:05.924479 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fb367a47-2c4a-4309-b04a-7a3cef563c73 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:05.924919 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fb367a47-2c4a-4309-b04a-7a3cef563c73 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:05.991863 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fb367a47-2c4a-4309-b04a-7a3cef563c73 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:05.992101 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fb367a47-2c4a-4309-b04a-7a3cef563c73 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1271 microversion: 2.1 time: 0.079429 Jul 26 16:35:05.992915 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 188/366] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:05 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1271 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:06.040269 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e3c0a9d3-d741-4cbb-b257-5dc721f9d781 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:06.040913 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e3c0a9d3-d741-4cbb-b257-5dc721f9d781 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:06.047680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3c0a9d3-d741-4cbb-b257-5dc721f9d781 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:06.048230 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3c0a9d3-d741-4cbb-b257-5dc721f9d781 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:06.049110 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3c0a9d3-d741-4cbb-b257-5dc721f9d781 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:06.049613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3c0a9d3-d741-4cbb-b257-5dc721f9d781 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:06.183820 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e3c0a9d3-d741-4cbb-b257-5dc721f9d781 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:06.191931 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e3c0a9d3-d741-4cbb-b257-5dc721f9d781 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:06.193470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e3c0a9d3-d741-4cbb-b257-5dc721f9d781 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:06.194582 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e3c0a9d3-d741-4cbb-b257-5dc721f9d781 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.158774 Jul 26 16:35:06.195143 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 179/367] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:06 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:35:06.443792 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3f7c5ea2-43a1-469a-bee1-2622bf125fef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:06.444325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3f7c5ea2-43a1-469a-bee1-2622bf125fef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:06.450814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3f7c5ea2-43a1-469a-bee1-2622bf125fef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:06.451260 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3f7c5ea2-43a1-469a-bee1-2622bf125fef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:06.452018 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3f7c5ea2-43a1-469a-bee1-2622bf125fef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:06.452490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3f7c5ea2-43a1-469a-bee1-2622bf125fef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:06.581586 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3f7c5ea2-43a1-469a-bee1-2622bf125fef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:06.589585 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3f7c5ea2-43a1-469a-bee1-2622bf125fef tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.149680 Jul 26 16:35:06.590151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 189/368] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:06 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:07.013158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-304ad2c6-3c3d-49a1-b6c6-86ca6cc79987 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:07.013770 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-304ad2c6-3c3d-49a1-b6c6-86ca6cc79987 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:07.020741 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-304ad2c6-3c3d-49a1-b6c6-86ca6cc79987 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:07.021194 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-304ad2c6-3c3d-49a1-b6c6-86ca6cc79987 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:07.021976 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-304ad2c6-3c3d-49a1-b6c6-86ca6cc79987 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:07.022433 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-304ad2c6-3c3d-49a1-b6c6-86ca6cc79987 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:07.089294 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-304ad2c6-3c3d-49a1-b6c6-86ca6cc79987 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:07.096629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-304ad2c6-3c3d-49a1-b6c6-86ca6cc79987 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1271 microversion: 2.1 time: 0.087320 Jul 26 16:35:07.097187 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 180/369] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:07 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:07.218415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-11732eb7-7154-496d-bb92-32644daf631a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:07.218872 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-11732eb7-7154-496d-bb92-32644daf631a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:07.221072 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:07.226020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-11732eb7-7154-496d-bb92-32644daf631a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:07.226468 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-11732eb7-7154-496d-bb92-32644daf631a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:07.227414 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-11732eb7-7154-496d-bb92-32644daf631a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:07.227842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-11732eb7-7154-496d-bb92-32644daf631a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:07.408486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-11732eb7-7154-496d-bb92-32644daf631a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:07.417619 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-11732eb7-7154-496d-bb92-32644daf631a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:07.419135 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-11732eb7-7154-496d-bb92-32644daf631a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:07.420343 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-11732eb7-7154-496d-bb92-32644daf631a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.206048 Jul 26 16:35:07.420920 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 190/370] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:07 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:35:07.611218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-961447b9-90f7-4692-8450-b35b471b0c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:07.612708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-961447b9-90f7-4692-8450-b35b471b0c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:07.620174 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-961447b9-90f7-4692-8450-b35b471b0c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:07.620662 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-961447b9-90f7-4692-8450-b35b471b0c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:07.621444 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-961447b9-90f7-4692-8450-b35b471b0c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:07.622005 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-961447b9-90f7-4692-8450-b35b471b0c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:07.687361 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-1675bb9d-832f-46cb-bb03-44d9081bd414 req-e523aa0c-0ba8-4b63-8f88-ffdb157d82d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d182cbe3-dff4-482c-a901-f084fc7b0077", "name": "network-vif-plugged", "status": "completed", "tag": "7f871a00-9630-48c9-845a-ddb06fb9a2df"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:07.697562 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-1675bb9d-832f-46cb-bb03-44d9081bd414 req-e523aa0c-0ba8-4b63-8f88-ffdb157d82d4 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:07.699107 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-1675bb9d-832f-46cb-bb03-44d9081bd414 req-e523aa0c-0ba8-4b63-8f88-ffdb157d82d4 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:07.709673 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-1675bb9d-832f-46cb-bb03-44d9081bd414 req-e523aa0c-0ba8-4b63-8f88-ffdb157d82d4 service nova] Creating event network-vif-plugged:7f871a00-9630-48c9-845a-ddb06fb9a2df for instance d182cbe3-dff4-482c-a901-f084fc7b0077 on hv-cinder-85104 Jul 26 16:35:07.715292 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-1675bb9d-832f-46cb-bb03-44d9081bd414 req-e523aa0c-0ba8-4b63-8f88-ffdb157d82d4 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031521 Jul 26 16:35:07.715929 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 191/371] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:35:07.772032 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-961447b9-90f7-4692-8450-b35b471b0c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:07.780689 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-961447b9-90f7-4692-8450-b35b471b0c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1513 microversion: 2.1 time: 0.173381 Jul 26 16:35:07.781312 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 181/372] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:07 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:08.118597 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c59c0c9c-d889-490a-bdc6-7f9ca5fd10b0 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:08.119682 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c59c0c9c-d889-490a-bdc6-7f9ca5fd10b0 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:08.126083 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c59c0c9c-d889-490a-bdc6-7f9ca5fd10b0 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:08.126457 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c59c0c9c-d889-490a-bdc6-7f9ca5fd10b0 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:08.127227 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c59c0c9c-d889-490a-bdc6-7f9ca5fd10b0 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:08.127653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c59c0c9c-d889-490a-bdc6-7f9ca5fd10b0 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:08.198418 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c59c0c9c-d889-490a-bdc6-7f9ca5fd10b0 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:08.206674 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c59c0c9c-d889-490a-bdc6-7f9ca5fd10b0 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1279 microversion: 2.1 time: 0.092911 Jul 26 16:35:08.209302 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 192/373] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:08 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:08.443142 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e34556ba-4544-4ec6-89b4-00baa85c2b31 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:08.443744 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e34556ba-4544-4ec6-89b4-00baa85c2b31 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:08.451605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e34556ba-4544-4ec6-89b4-00baa85c2b31 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:08.452349 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e34556ba-4544-4ec6-89b4-00baa85c2b31 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:08.453296 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e34556ba-4544-4ec6-89b4-00baa85c2b31 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:08.453946 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e34556ba-4544-4ec6-89b4-00baa85c2b31 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:08.602538 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e34556ba-4544-4ec6-89b4-00baa85c2b31 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:08.614598 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e34556ba-4544-4ec6-89b4-00baa85c2b31 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:08.614598 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e34556ba-4544-4ec6-89b4-00baa85c2b31 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:08.614598 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e34556ba-4544-4ec6-89b4-00baa85c2b31 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.174883 Jul 26 16:35:08.622832 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 182/374] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:08 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:35:08.802150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-936db582-3b69-4b9a-b963-33c1b748edad tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:08.802757 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-936db582-3b69-4b9a-b963-33c1b748edad tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:08.808980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-936db582-3b69-4b9a-b963-33c1b748edad tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:08.809435 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-936db582-3b69-4b9a-b963-33c1b748edad tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:08.810206 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-936db582-3b69-4b9a-b963-33c1b748edad tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:08.810823 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-936db582-3b69-4b9a-b963-33c1b748edad tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:08.829827 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:08.951403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-936db582-3b69-4b9a-b963-33c1b748edad tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:08.959166 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-936db582-3b69-4b9a-b963-33c1b748edad tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1519 microversion: 2.1 time: 0.160709 Jul 26 16:35:08.960464 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 193/375] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:08 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:09.227732 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-74d70845-b456-47a5-830a-21d9044619e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:09.228331 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-74d70845-b456-47a5-830a-21d9044619e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:09.234380 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-74d70845-b456-47a5-830a-21d9044619e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:09.234821 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-74d70845-b456-47a5-830a-21d9044619e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:09.235639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-74d70845-b456-47a5-830a-21d9044619e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:09.236221 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-74d70845-b456-47a5-830a-21d9044619e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:09.310296 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-74d70845-b456-47a5-830a-21d9044619e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:09.317674 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-74d70845-b456-47a5-830a-21d9044619e6 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1277 microversion: 2.1 time: 0.093793 Jul 26 16:35:09.318409 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 183/376] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:09 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1277 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:09.645854 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f4bc971a-036b-4ead-9f13-73ac9d22a300 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:09.645854 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f4bc971a-036b-4ead-9f13-73ac9d22a300 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:09.647198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f4bc971a-036b-4ead-9f13-73ac9d22a300 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:09.647688 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f4bc971a-036b-4ead-9f13-73ac9d22a300 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:09.648509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f4bc971a-036b-4ead-9f13-73ac9d22a300 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:09.648949 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f4bc971a-036b-4ead-9f13-73ac9d22a300 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:09.809946 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f4bc971a-036b-4ead-9f13-73ac9d22a300 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:09.820210 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f4bc971a-036b-4ead-9f13-73ac9d22a300 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:09.821885 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f4bc971a-036b-4ead-9f13-73ac9d22a300 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:09.823397 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f4bc971a-036b-4ead-9f13-73ac9d22a300 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.191523 Jul 26 16:35:09.832983 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 194/377] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:09 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:35:10.339232 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-dda41f90-f22c-4214-8381-4564d58fa179 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:10.340086 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-dda41f90-f22c-4214-8381-4564d58fa179 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:10.346287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dda41f90-f22c-4214-8381-4564d58fa179 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:10.346727 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dda41f90-f22c-4214-8381-4564d58fa179 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:10.352900 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dda41f90-f22c-4214-8381-4564d58fa179 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:10.352900 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dda41f90-f22c-4214-8381-4564d58fa179 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:10.492600 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-dda41f90-f22c-4214-8381-4564d58fa179 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:10.502551 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-dda41f90-f22c-4214-8381-4564d58fa179 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.167137 Jul 26 16:35:10.503117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 184/378] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:10 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:10.847646 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-35c202ba-505d-4278-b98d-b61d0373108c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:10.848215 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-35c202ba-505d-4278-b98d-b61d0373108c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:10.857450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-35c202ba-505d-4278-b98d-b61d0373108c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:10.857450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-35c202ba-505d-4278-b98d-b61d0373108c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:10.857450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-35c202ba-505d-4278-b98d-b61d0373108c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:10.857450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-35c202ba-505d-4278-b98d-b61d0373108c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:10.957052 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-49d90dea-8edc-4bd4-bbc8-ef21a3dfd49b req-3a17d3b5-92e3-438c-816f-f4e1ceb8dabe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e056b84-1d84-4c83-9d54-2779af4ab7ef", "tag": "6350c4bd-2e65-40f8-bc8a-c2ce95ef3034"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:10.969022 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-49d90dea-8edc-4bd4-bbc8-ef21a3dfd49b req-3a17d3b5-92e3-438c-816f-f4e1ceb8dabe service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:10.969784 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-49d90dea-8edc-4bd4-bbc8-ef21a3dfd49b req-3a17d3b5-92e3-438c-816f-f4e1ceb8dabe service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:10.993582 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-49d90dea-8edc-4bd4-bbc8-ef21a3dfd49b req-3a17d3b5-92e3-438c-816f-f4e1ceb8dabe service nova] Creating event network-changed:6350c4bd-2e65-40f8-bc8a-c2ce95ef3034 for instance 6e056b84-1d84-4c83-9d54-2779af4ab7ef on hv-cinder-85104 Jul 26 16:35:11.000272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-49d90dea-8edc-4bd4-bbc8-ef21a3dfd49b req-3a17d3b5-92e3-438c-816f-f4e1ceb8dabe service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046964 Jul 26 16:35:11.000914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 185/379] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:35:11.220409 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-35c202ba-505d-4278-b98d-b61d0373108c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:11.230970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-35c202ba-505d-4278-b98d-b61d0373108c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:11.232774 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-35c202ba-505d-4278-b98d-b61d0373108c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:11.234798 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-35c202ba-505d-4278-b98d-b61d0373108c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1410 microversion: 2.20 time: 0.390895 Jul 26 16:35:11.234798 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 195/380] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:10 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1410 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:35:11.524370 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2ab61436-ab46-4460-9db8-81e3e3e2a417 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:11.525116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2ab61436-ab46-4460-9db8-81e3e3e2a417 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:11.531699 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2ab61436-ab46-4460-9db8-81e3e3e2a417 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:11.532225 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2ab61436-ab46-4460-9db8-81e3e3e2a417 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:11.532999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2ab61436-ab46-4460-9db8-81e3e3e2a417 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:11.533428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2ab61436-ab46-4460-9db8-81e3e3e2a417 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:11.777468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2ab61436-ab46-4460-9db8-81e3e3e2a417 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:11.788690 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2ab61436-ab46-4460-9db8-81e3e3e2a417 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.268046 Jul 26 16:35:11.789192 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 186/381] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:11 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:12.277386 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9359523c-2d7d-4397-97c9-8a1680eaef52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:12.278156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9359523c-2d7d-4397-97c9-8a1680eaef52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:12.284849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9359523c-2d7d-4397-97c9-8a1680eaef52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:12.285326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9359523c-2d7d-4397-97c9-8a1680eaef52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:12.286104 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9359523c-2d7d-4397-97c9-8a1680eaef52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:12.286541 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9359523c-2d7d-4397-97c9-8a1680eaef52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:12.433879 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9359523c-2d7d-4397-97c9-8a1680eaef52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:12.441955 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9359523c-2d7d-4397-97c9-8a1680eaef52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:12.443507 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9359523c-2d7d-4397-97c9-8a1680eaef52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:12.445287 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9359523c-2d7d-4397-97c9-8a1680eaef52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1601 microversion: 2.20 time: 0.190370 Jul 26 16:35:12.445846 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 196/382] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:35:12 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1601 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:35:12.466984 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5837924d-cca0-451b-9172-d7e994c95e2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:12.467506 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5837924d-cca0-451b-9172-d7e994c95e2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:12.473980 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5837924d-cca0-451b-9172-d7e994c95e2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:12.474613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5837924d-cca0-451b-9172-d7e994c95e2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:12.475563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5837924d-cca0-451b-9172-d7e994c95e2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:12.476177 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5837924d-cca0-451b-9172-d7e994c95e2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:12.493529 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:12.606544 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5837924d-cca0-451b-9172-d7e994c95e2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.143404 Jul 26 16:35:12.607193 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 187/383] 10.222.0.144 () {60 vars in 1321 bytes} [Tue Jul 26 16:35:12 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:35:12.811233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e3f9b53a-5c52-4197-9bf6-acf38199debd tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:12.812100 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e3f9b53a-5c52-4197-9bf6-acf38199debd tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:12.826496 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e3f9b53a-5c52-4197-9bf6-acf38199debd tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:12.826956 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e3f9b53a-5c52-4197-9bf6-acf38199debd tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:12.827745 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e3f9b53a-5c52-4197-9bf6-acf38199debd tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:12.828366 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e3f9b53a-5c52-4197-9bf6-acf38199debd tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:12.991586 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c2a529b6-79d9-4ae0-ae65-8ead5176bd6a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'create', calling method: .version_select at 0x7f4b6c3b6b80>, body: {"keypair": {"name": "tempest-keypair-1747126979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9KsCI5AEG6vQt4GTbk8qcDblOR64pSy1ofcuPKGNLbPIa6+uXKb8hwZAGpXeCwp9gjxp+X3BAD/gke4TxEkuLgaunj6bz8OqyfP1BBxeZ7ZUI8LJtYZIivRRUBTettng=="}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:13.014869 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-c2a529b6-79d9-4ae0-ae65-8ead5176bd6a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Getting quotas for project 08a954085f8f454698c55faa9351ad6e. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:35:13.020979 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-c2a529b6-79d9-4ae0-ae65-8ead5176bd6a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Getting quotas for user 07e70b1c968443eab469777283b8fb50 and project 08a954085f8f454698c55faa9351ad6e. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:35:13.234490 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c2a529b6-79d9-4ae0-ae65-8ead5176bd6a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.246740 Jul 26 16:35:13.241058 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e3f9b53a-5c52-4197-9bf6-acf38199debd tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:13.241954 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 188/384] 10.222.0.144 () {60 vars in 1164 bytes} [Tue Jul 26 16:35:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:35:13.250851 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e3f9b53a-5c52-4197-9bf6-acf38199debd tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.443636 Jul 26 16:35:13.262585 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 197/385] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:12 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:14.272102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-54a47060-3350-4354-ae76-3d5d19099928 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:14.273889 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-54a47060-3350-4354-ae76-3d5d19099928 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:14.283727 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-54a47060-3350-4354-ae76-3d5d19099928 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:14.284535 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-54a47060-3350-4354-ae76-3d5d19099928 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:14.285503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-54a47060-3350-4354-ae76-3d5d19099928 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:14.286146 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-54a47060-3350-4354-ae76-3d5d19099928 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:14.394223 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-8f954655-9a8c-4d32-ab39-e0636a21b849 req-4031c100-f3cd-4e2e-98d5-b1303e1c4075 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d182cbe3-dff4-482c-a901-f084fc7b0077", "tag": "7f871a00-9630-48c9-845a-ddb06fb9a2df"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:14.413621 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-8f954655-9a8c-4d32-ab39-e0636a21b849 req-4031c100-f3cd-4e2e-98d5-b1303e1c4075 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:14.414441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-8f954655-9a8c-4d32-ab39-e0636a21b849 req-4031c100-f3cd-4e2e-98d5-b1303e1c4075 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:14.439133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-8f954655-9a8c-4d32-ab39-e0636a21b849 req-4031c100-f3cd-4e2e-98d5-b1303e1c4075 service nova] Creating event network-changed:7f871a00-9630-48c9-845a-ddb06fb9a2df for instance d182cbe3-dff4-482c-a901-f084fc7b0077 on hv-cinder-85104 Jul 26 16:35:14.446772 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-8f954655-9a8c-4d32-ab39-e0636a21b849 req-4031c100-f3cd-4e2e-98d5-b1303e1c4075 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057997 Jul 26 16:35:14.448241 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 198/386] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:35:14.572871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-54a47060-3350-4354-ae76-3d5d19099928 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:14.586495 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-54a47060-3350-4354-ae76-3d5d19099928 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.318908 Jul 26 16:35:14.587683 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 189/387] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:14 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:15.608333 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-bf177319-53b8-4bbd-84ca-96c862db6f21 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:15.608995 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-bf177319-53b8-4bbd-84ca-96c862db6f21 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:15.620217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bf177319-53b8-4bbd-84ca-96c862db6f21 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:15.621207 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bf177319-53b8-4bbd-84ca-96c862db6f21 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:15.622888 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bf177319-53b8-4bbd-84ca-96c862db6f21 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:15.627078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bf177319-53b8-4bbd-84ca-96c862db6f21 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:15.825440 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-bf177319-53b8-4bbd-84ca-96c862db6f21 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:15.833678 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-bf177319-53b8-4bbd-84ca-96c862db6f21 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.229595 Jul 26 16:35:15.834812 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 199/388] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:15 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:16.856271 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e7a2a5a4-623b-4ce4-a6de-f1c2970df9b7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:16.856910 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e7a2a5a4-623b-4ce4-a6de-f1c2970df9b7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:16.867633 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e7a2a5a4-623b-4ce4-a6de-f1c2970df9b7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:16.868486 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e7a2a5a4-623b-4ce4-a6de-f1c2970df9b7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:16.868707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e7a2a5a4-623b-4ce4-a6de-f1c2970df9b7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:16.869636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e7a2a5a4-623b-4ce4-a6de-f1c2970df9b7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:17.040429 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e7a2a5a4-623b-4ce4-a6de-f1c2970df9b7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:17.048059 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e7a2a5a4-623b-4ce4-a6de-f1c2970df9b7 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.196110 Jul 26 16:35:17.060753 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 190/389] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:16 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:17.110209 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-623884971", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "75185dc6-2be4-492f-849d-964d05de909f"}], "security_groups": [{"name": "tempest-securitygroup--1384205362"}], "key_name": "tempest-keypair-1747126979", "user_data": "}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:17.217093 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] validate_networks() for [('75185dc6-2be4-492f-849d-964d05de909f', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:35:17.719121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:35:17.719904 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:35:17.720157 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:35:17.720599 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:35:17.721112 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:35:17.730928 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:17.731373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:17.732265 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:17.732624 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:17.749583 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Getting quotas for project 08a954085f8f454698c55faa9351ad6e. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:35:17.753568 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Getting quotas for user 07e70b1c968443eab469777283b8fb50 and project 08a954085f8f454698c55faa9351ad6e. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:35:17.765163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:35:17.767418 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:35:17.973080 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5f9a5acd-8463-4d7e-842b-09d27afd2587 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 411 microversion: 2.1 time: 0.867485 Jul 26 16:35:17.974219 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 200/390] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:35:17 2022] POST /compute/v2.1/servers => generated 411 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:35:17.991445 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-77d3ee1a-b757-4d24-80bd-e3be824f2d1b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:17.993018 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-77d3ee1a-b757-4d24-80bd-e3be824f2d1b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:18.073675 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b222fc23-64c6-43c1-aa46-54cc86753d4f tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:18.074299 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b222fc23-64c6-43c1-aa46-54cc86753d4f tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:18.082337 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-77d3ee1a-b757-4d24-80bd-e3be824f2d1b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:18.083252 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b222fc23-64c6-43c1-aa46-54cc86753d4f tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:18.083712 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b222fc23-64c6-43c1-aa46-54cc86753d4f tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:18.086381 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b222fc23-64c6-43c1-aa46-54cc86753d4f tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:18.086837 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b222fc23-64c6-43c1-aa46-54cc86753d4f tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:18.091346 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-77d3ee1a-b757-4d24-80bd-e3be824f2d1b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1249 microversion: 2.1 time: 0.104295 Jul 26 16:35:18.092511 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 191/391] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:17 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1249 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:18.244225 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b222fc23-64c6-43c1-aa46-54cc86753d4f tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:18.251970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b222fc23-64c6-43c1-aa46-54cc86753d4f tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.182806 Jul 26 16:35:18.252579 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 201/392] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:18 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:19.113848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-19378a54-4460-4343-b76d-22ef92276e4f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:19.114538 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-19378a54-4460-4343-b76d-22ef92276e4f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:19.171418 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-19378a54-4460-4343-b76d-22ef92276e4f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:19.178166 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-19378a54-4460-4343-b76d-22ef92276e4f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1249 microversion: 2.1 time: 0.068248 Jul 26 16:35:19.179257 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 192/393] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:19 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1249 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:19.273521 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-75ac7615-d220-4ec1-9ab4-18043e04bcfb tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:19.274763 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-75ac7615-d220-4ec1-9ab4-18043e04bcfb tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:19.281173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-75ac7615-d220-4ec1-9ab4-18043e04bcfb tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:19.281622 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-75ac7615-d220-4ec1-9ab4-18043e04bcfb tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:19.282389 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-75ac7615-d220-4ec1-9ab4-18043e04bcfb tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:19.282819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-75ac7615-d220-4ec1-9ab4-18043e04bcfb tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:19.438600 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-75ac7615-d220-4ec1-9ab4-18043e04bcfb tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:19.450044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-75ac7615-d220-4ec1-9ab4-18043e04bcfb tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.180143 Jul 26 16:35:19.450692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 202/394] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:19 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:20.200785 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-adbea6e3-312d-425a-9368-978b13c5749c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:20.201679 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-adbea6e3-312d-425a-9368-978b13c5749c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:20.204432 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:20.212612 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-adbea6e3-312d-425a-9368-978b13c5749c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:20.213319 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-adbea6e3-312d-425a-9368-978b13c5749c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:20.214182 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-adbea6e3-312d-425a-9368-978b13c5749c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:20.214701 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-adbea6e3-312d-425a-9368-978b13c5749c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:20.284692 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-adbea6e3-312d-425a-9368-978b13c5749c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:20.294098 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-adbea6e3-312d-425a-9368-978b13c5749c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1253 microversion: 2.1 time: 0.097976 Jul 26 16:35:20.294830 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 193/395] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:20 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1253 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:20.471180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-81fcc656-f3e2-4230-bbaa-6392a40bde88 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:20.479278 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-81fcc656-f3e2-4230-bbaa-6392a40bde88 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:20.479278 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-81fcc656-f3e2-4230-bbaa-6392a40bde88 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:20.479278 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-81fcc656-f3e2-4230-bbaa-6392a40bde88 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:20.479727 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-81fcc656-f3e2-4230-bbaa-6392a40bde88 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:20.480024 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-81fcc656-f3e2-4230-bbaa-6392a40bde88 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:20.633667 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-81fcc656-f3e2-4230-bbaa-6392a40bde88 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:20.647808 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-81fcc656-f3e2-4230-bbaa-6392a40bde88 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.180423 Jul 26 16:35:20.661309 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 203/396] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:20 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:21.315407 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-626814a6-96c6-4a6c-a5fb-3e988dad4193 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:21.316180 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-626814a6-96c6-4a6c-a5fb-3e988dad4193 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:21.322297 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-626814a6-96c6-4a6c-a5fb-3e988dad4193 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:21.322739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-626814a6-96c6-4a6c-a5fb-3e988dad4193 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:21.323510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-626814a6-96c6-4a6c-a5fb-3e988dad4193 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:21.323937 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-626814a6-96c6-4a6c-a5fb-3e988dad4193 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:21.403675 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-626814a6-96c6-4a6c-a5fb-3e988dad4193 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:21.413525 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-626814a6-96c6-4a6c-a5fb-3e988dad4193 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1301 microversion: 2.1 time: 0.101399 Jul 26 16:35:21.414181 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 194/397] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:21 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:21.668112 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e99fbcd7-6bf6-45bc-aef6-322ee3cf9709 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:21.669329 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e99fbcd7-6bf6-45bc-aef6-322ee3cf9709 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:21.679946 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e99fbcd7-6bf6-45bc-aef6-322ee3cf9709 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:21.680813 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e99fbcd7-6bf6-45bc-aef6-322ee3cf9709 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:21.682407 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e99fbcd7-6bf6-45bc-aef6-322ee3cf9709 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:21.683543 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e99fbcd7-6bf6-45bc-aef6-322ee3cf9709 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:22.005604 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e99fbcd7-6bf6-45bc-aef6-322ee3cf9709 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:22.015175 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e99fbcd7-6bf6-45bc-aef6-322ee3cf9709 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.350699 Jul 26 16:35:22.018896 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 204/398] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:21 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:22.441182 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0ca7404f-5df9-4bdd-b863-ba974e77bea7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:22.441773 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0ca7404f-5df9-4bdd-b863-ba974e77bea7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:22.448962 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0ca7404f-5df9-4bdd-b863-ba974e77bea7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:22.449362 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0ca7404f-5df9-4bdd-b863-ba974e77bea7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:22.450126 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0ca7404f-5df9-4bdd-b863-ba974e77bea7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:22.450562 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0ca7404f-5df9-4bdd-b863-ba974e77bea7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:22.528732 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0ca7404f-5df9-4bdd-b863-ba974e77bea7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:22.536243 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0ca7404f-5df9-4bdd-b863-ba974e77bea7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1319 microversion: 2.1 time: 0.099292 Jul 26 16:35:22.537038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 195/399] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:22 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1319 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:23.001561 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-51251e2b-cd17-42dc-8a6d-9b78c9ca42d4 req-795b6a6c-6adf-4fb3-870a-8c609202bbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e056b84-1d84-4c83-9d54-2779af4ab7ef", "name": "network-vif-plugged", "status": "completed", "tag": "6350c4bd-2e65-40f8-bc8a-c2ce95ef3034"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:23.013815 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-51251e2b-cd17-42dc-8a6d-9b78c9ca42d4 req-795b6a6c-6adf-4fb3-870a-8c609202bbd7 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:23.014265 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-51251e2b-cd17-42dc-8a6d-9b78c9ca42d4 req-795b6a6c-6adf-4fb3-870a-8c609202bbd7 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:23.033665 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-51251e2b-cd17-42dc-8a6d-9b78c9ca42d4 req-795b6a6c-6adf-4fb3-870a-8c609202bbd7 service nova] Creating event network-vif-plugged:6350c4bd-2e65-40f8-bc8a-c2ce95ef3034 for instance 6e056b84-1d84-4c83-9d54-2779af4ab7ef on hv-cinder-85104 Jul 26 16:35:23.043662 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5acc609b-87c4-437e-b6d4-d400f104a822 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:23.044282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5acc609b-87c4-437e-b6d4-d400f104a822 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:23.051552 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5acc609b-87c4-437e-b6d4-d400f104a822 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:23.052038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5acc609b-87c4-437e-b6d4-d400f104a822 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:23.054284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-51251e2b-cd17-42dc-8a6d-9b78c9ca42d4 req-795b6a6c-6adf-4fb3-870a-8c609202bbd7 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056213 Jul 26 16:35:23.054892 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 205/400] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:35:23.055756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5acc609b-87c4-437e-b6d4-d400f104a822 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:23.056375 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5acc609b-87c4-437e-b6d4-d400f104a822 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:23.277153 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5acc609b-87c4-437e-b6d4-d400f104a822 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:23.285103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5acc609b-87c4-437e-b6d4-d400f104a822 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.245183 Jul 26 16:35:23.297307 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 196/401] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:23 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:23.562829 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-06ffd350-d70e-4b6c-afe2-eab202de503d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:23.563890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-06ffd350-d70e-4b6c-afe2-eab202de503d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:23.575018 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-06ffd350-d70e-4b6c-afe2-eab202de503d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:23.577610 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-06ffd350-d70e-4b6c-afe2-eab202de503d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:23.578641 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-06ffd350-d70e-4b6c-afe2-eab202de503d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:23.579207 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-06ffd350-d70e-4b6c-afe2-eab202de503d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:23.842579 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-06ffd350-d70e-4b6c-afe2-eab202de503d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:23.856294 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-06ffd350-d70e-4b6c-afe2-eab202de503d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.296983 Jul 26 16:35:23.863517 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 206/402] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:23 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:24.228506 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-abd10312-e14a-43d6-a1c1-ec9b83da619a req-452e4097-ec51-4593-8d04-4c56e0b91e4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3a6262-8adc-4597-8d00-35af06cee7de", "tag": "b93e292a-28ec-4647-a984-c0d6bb8814e5"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:24.241372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-abd10312-e14a-43d6-a1c1-ec9b83da619a req-452e4097-ec51-4593-8d04-4c56e0b91e4d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:24.241811 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-abd10312-e14a-43d6-a1c1-ec9b83da619a req-452e4097-ec51-4593-8d04-4c56e0b91e4d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:24.260100 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-abd10312-e14a-43d6-a1c1-ec9b83da619a req-452e4097-ec51-4593-8d04-4c56e0b91e4d service nova] Creating event network-changed:b93e292a-28ec-4647-a984-c0d6bb8814e5 for instance 7b3a6262-8adc-4597-8d00-35af06cee7de on hv-cinder-85104 Jul 26 16:35:24.274991 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-abd10312-e14a-43d6-a1c1-ec9b83da619a req-452e4097-ec51-4593-8d04-4c56e0b91e4d service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051106 Jul 26 16:35:24.275788 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 197/403] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:35:24.307615 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e35dd677-61db-4589-a02c-8bf29da8a1f5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:24.308886 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e35dd677-61db-4589-a02c-8bf29da8a1f5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:24.315442 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e35dd677-61db-4589-a02c-8bf29da8a1f5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:24.315901 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e35dd677-61db-4589-a02c-8bf29da8a1f5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:24.316724 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e35dd677-61db-4589-a02c-8bf29da8a1f5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:24.317163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e35dd677-61db-4589-a02c-8bf29da8a1f5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:24.569929 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e35dd677-61db-4589-a02c-8bf29da8a1f5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:24.577639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e35dd677-61db-4589-a02c-8bf29da8a1f5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.274364 Jul 26 16:35:24.578219 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 207/404] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:24 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:24.880349 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-45132ffc-35e7-451d-8684-ea3f110f81ee tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:24.881171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-45132ffc-35e7-451d-8684-ea3f110f81ee tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:24.887714 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-45132ffc-35e7-451d-8684-ea3f110f81ee tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:24.888285 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-45132ffc-35e7-451d-8684-ea3f110f81ee tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:24.889379 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-45132ffc-35e7-451d-8684-ea3f110f81ee tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:24.889975 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-45132ffc-35e7-451d-8684-ea3f110f81ee tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:25.058439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-45132ffc-35e7-451d-8684-ea3f110f81ee tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:25.065953 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-45132ffc-35e7-451d-8684-ea3f110f81ee tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.190373 Jul 26 16:35:25.066525 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 198/405] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:24 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:25.600725 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ee0b7d50-a9f3-4399-be66-b5e521a0afb9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:25.605922 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ee0b7d50-a9f3-4399-be66-b5e521a0afb9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:25.610465 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ee0b7d50-a9f3-4399-be66-b5e521a0afb9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:25.610950 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ee0b7d50-a9f3-4399-be66-b5e521a0afb9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:25.612071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ee0b7d50-a9f3-4399-be66-b5e521a0afb9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:25.612540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ee0b7d50-a9f3-4399-be66-b5e521a0afb9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:25.826614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ee0b7d50-a9f3-4399-be66-b5e521a0afb9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:25.835756 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ee0b7d50-a9f3-4399-be66-b5e521a0afb9 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1319 microversion: 2.1 time: 0.239883 Jul 26 16:35:25.836360 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 208/406] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:25 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:26.086718 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c48186e5-a881-4820-b098-9a5a0f22e239 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:26.088450 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c48186e5-a881-4820-b098-9a5a0f22e239 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:26.093942 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c48186e5-a881-4820-b098-9a5a0f22e239 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:26.094619 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c48186e5-a881-4820-b098-9a5a0f22e239 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:26.095581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c48186e5-a881-4820-b098-9a5a0f22e239 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:26.096264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c48186e5-a881-4820-b098-9a5a0f22e239 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:26.794218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c48186e5-a881-4820-b098-9a5a0f22e239 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:26.794218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c48186e5-a881-4820-b098-9a5a0f22e239 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.297844 Jul 26 16:35:26.794218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 199/407] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:26 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:26.797668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-947d7673-925b-402d-abd8-2fd63e8d7391 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Action: 'create', calling method: .version_select at 0x7f4b6c23e280>, body: {"keypair": {"name": "tempest-TestShelveInstance-760029829", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJhr2tDCHnCo7joLExUzgDFOeB/6xSxsptAnaR+jWqG3u4NISbfPs+7PZoMxVnK+2v2sQly8knmTmju9ICjqZrhlGB4alpNWDYlU5k30gjWK9+yWKUrRBVJX0gqRxzN2A=="}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:26.797668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-947d7673-925b-402d-abd8-2fd63e8d7391 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Getting quotas for project 22e3bf7bb6ef4ca8bb2353bdfe4e90a3. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:35:26.797668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-947d7673-925b-402d-abd8-2fd63e8d7391 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Getting quotas for user 3b089f2cc22449329110fd3cfafecd53 and project 22e3bf7bb6ef4ca8bb2353bdfe4e90a3. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:35:26.872965 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1c1ee18b-714e-4eea-895d-870280829b94 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:26.872965 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1c1ee18b-714e-4eea-895d-870280829b94 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:26.872965 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1c1ee18b-714e-4eea-895d-870280829b94 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:26.872965 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1c1ee18b-714e-4eea-895d-870280829b94 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:26.873429 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1c1ee18b-714e-4eea-895d-870280829b94 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:26.873429 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1c1ee18b-714e-4eea-895d-870280829b94 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:26.998571 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1c1ee18b-714e-4eea-895d-870280829b94 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:27.006416 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1c1ee18b-714e-4eea-895d-870280829b94 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1469 microversion: 2.1 time: 0.153508 Jul 26 16:35:27.007553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 200/408] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:26 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:27.053546 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bf688a14-4667-4f5d-a482-e2ba8d23ad6a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:27.053972 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bf688a14-4667-4f5d-a482-e2ba8d23ad6a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:27.060157 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bf688a14-4667-4f5d-a482-e2ba8d23ad6a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:27.060650 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bf688a14-4667-4f5d-a482-e2ba8d23ad6a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:27.061404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bf688a14-4667-4f5d-a482-e2ba8d23ad6a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:27.061838 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bf688a14-4667-4f5d-a482-e2ba8d23ad6a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:27.081943 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-947d7673-925b-402d-abd8-2fd63e8d7391 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.527274 Jul 26 16:35:27.084996 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 209/409] 10.222.0.144 () {60 vars in 1164 bytes} [Tue Jul 26 16:35:26 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:35:27.092133 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bf688a14-4667-4f5d-a482-e2ba8d23ad6a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:35:27.401019 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d0c36244-7021-4b90-9932-405af94fd490 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:27.401626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d0c36244-7021-4b90-9932-405af94fd490 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:27.407596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0c36244-7021-4b90-9932-405af94fd490 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:27.408039 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0c36244-7021-4b90-9932-405af94fd490 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:27.408824 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0c36244-7021-4b90-9932-405af94fd490 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:27.409252 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0c36244-7021-4b90-9932-405af94fd490 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:27.543191 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d0c36244-7021-4b90-9932-405af94fd490 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:27.550575 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d0c36244-7021-4b90-9932-405af94fd490 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.153573 Jul 26 16:35:27.551210 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 210/410] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:27 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:27.718467 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bf688a14-4667-4f5d-a482-e2ba8d23ad6a tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "DELETE /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 204 len: 0 microversion: 2.1 time: 0.668504 Jul 26 16:35:27.719059 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 201/411] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:35:27 2022] DELETE /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 16:35:27.729233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-27608b40-aa4c-412e-995c-4e6b7d0141fa tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:27.733164 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-27608b40-aa4c-412e-995c-4e6b7d0141fa tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:27.736664 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-27608b40-aa4c-412e-995c-4e6b7d0141fa tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:27.737110 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-27608b40-aa4c-412e-995c-4e6b7d0141fa tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:27.738001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-27608b40-aa4c-412e-995c-4e6b7d0141fa tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:27.738441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-27608b40-aa4c-412e-995c-4e6b7d0141fa tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:27.743924 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:27.877390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-27608b40-aa4c-412e-995c-4e6b7d0141fa tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:27.886195 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-27608b40-aa4c-412e-995c-4e6b7d0141fa tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1475 microversion: 2.1 time: 0.162143 Jul 26 16:35:27.887104 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 211/412] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:27 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1475 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:28.576958 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c4c641f9-aa57-4fc4-9efb-7bf44047746d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:28.578269 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c4c641f9-aa57-4fc4-9efb-7bf44047746d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:28.586477 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c4c641f9-aa57-4fc4-9efb-7bf44047746d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:28.586937 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c4c641f9-aa57-4fc4-9efb-7bf44047746d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:28.587726 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c4c641f9-aa57-4fc4-9efb-7bf44047746d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:28.588156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c4c641f9-aa57-4fc4-9efb-7bf44047746d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:28.731743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c4c641f9-aa57-4fc4-9efb-7bf44047746d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:28.746769 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c4c641f9-aa57-4fc4-9efb-7bf44047746d tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.178718 Jul 26 16:35:28.760120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 202/413] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:28 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:28.910694 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e2792b2a-75e7-48cb-a353-87b435682739 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:28.911303 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e2792b2a-75e7-48cb-a353-87b435682739 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:28.931515 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e2792b2a-75e7-48cb-a353-87b435682739 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:28.934361 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e2792b2a-75e7-48cb-a353-87b435682739 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:28.935457 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e2792b2a-75e7-48cb-a353-87b435682739 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:28.938774 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e2792b2a-75e7-48cb-a353-87b435682739 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:29.094006 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e2792b2a-75e7-48cb-a353-87b435682739 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:29.102516 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e2792b2a-75e7-48cb-a353-87b435682739 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1475 microversion: 2.1 time: 0.197322 Jul 26 16:35:29.103097 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 212/414] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:28 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1475 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:29.767142 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-92fd5728-504e-426f-9c0d-015899ca9f85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:29.767782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-92fd5728-504e-426f-9c0d-015899ca9f85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:29.770049 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=8 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:29.775831 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-92fd5728-504e-426f-9c0d-015899ca9f85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:29.776286 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-92fd5728-504e-426f-9c0d-015899ca9f85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:29.777089 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-92fd5728-504e-426f-9c0d-015899ca9f85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:29.777524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-92fd5728-504e-426f-9c0d-015899ca9f85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:29.906369 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-92fd5728-504e-426f-9c0d-015899ca9f85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:29.913775 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-92fd5728-504e-426f-9c0d-015899ca9f85 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.150532 Jul 26 16:35:29.914340 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 203/415] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:29 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:30.124269 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-54df71d1-9adc-4d5d-aff0-b2c4d2cb3fe4 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:30.124914 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-54df71d1-9adc-4d5d-aff0-b2c4d2cb3fe4 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:30.131463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-54df71d1-9adc-4d5d-aff0-b2c4d2cb3fe4 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:30.132442 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-54df71d1-9adc-4d5d-aff0-b2c4d2cb3fe4 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:30.133248 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-54df71d1-9adc-4d5d-aff0-b2c4d2cb3fe4 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:30.133688 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-54df71d1-9adc-4d5d-aff0-b2c4d2cb3fe4 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:30.137561 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:30.272699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-54df71d1-9adc-4d5d-aff0-b2c4d2cb3fe4 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:30.280740 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-54df71d1-9adc-4d5d-aff0-b2c4d2cb3fe4 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1475 microversion: 2.1 time: 0.160254 Jul 26 16:35:30.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 213/416] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:30 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1475 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:30.935432 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4bd6e0b0-b0ce-4d9b-bd5a-1a25d9736a2c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:30.936742 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4bd6e0b0-b0ce-4d9b-bd5a-1a25d9736a2c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:30.946525 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4bd6e0b0-b0ce-4d9b-bd5a-1a25d9736a2c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:30.946983 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4bd6e0b0-b0ce-4d9b-bd5a-1a25d9736a2c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:30.947759 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4bd6e0b0-b0ce-4d9b-bd5a-1a25d9736a2c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:30.948258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4bd6e0b0-b0ce-4d9b-bd5a-1a25d9736a2c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:31.090732 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4bd6e0b0-b0ce-4d9b-bd5a-1a25d9736a2c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:31.098279 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4bd6e0b0-b0ce-4d9b-bd5a-1a25d9736a2c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.167352 Jul 26 16:35:31.098938 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 204/417] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:30 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:31.301930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a1b50c22-2bd1-4271-ae84-a6deeddd665c tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:31.302540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a1b50c22-2bd1-4271-ae84-a6deeddd665c tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:31.309156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1b50c22-2bd1-4271-ae84-a6deeddd665c tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:31.309600 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1b50c22-2bd1-4271-ae84-a6deeddd665c tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:31.310350 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1b50c22-2bd1-4271-ae84-a6deeddd665c tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:31.310775 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1b50c22-2bd1-4271-ae84-a6deeddd665c tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:31.437701 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a1b50c22-2bd1-4271-ae84-a6deeddd665c tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:31.445318 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a1b50c22-2bd1-4271-ae84-a6deeddd665c tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1475 microversion: 2.1 time: 0.147283 Jul 26 16:35:31.445887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 214/418] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:31 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1475 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:32.119256 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-06c3ec3d-5baa-4e02-970b-1271cda71a23 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:32.119971 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-06c3ec3d-5baa-4e02-970b-1271cda71a23 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:32.126521 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-06c3ec3d-5baa-4e02-970b-1271cda71a23 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:32.126965 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-06c3ec3d-5baa-4e02-970b-1271cda71a23 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:32.127715 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-06c3ec3d-5baa-4e02-970b-1271cda71a23 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:32.128141 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-06c3ec3d-5baa-4e02-970b-1271cda71a23 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:32.255357 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-06c3ec3d-5baa-4e02-970b-1271cda71a23 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:32.263243 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-06c3ec3d-5baa-4e02-970b-1271cda71a23 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.148076 Jul 26 16:35:32.263808 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 205/419] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:32 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:32.467897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6ec25d0c-b272-4c15-80c8-370fd6e41ca3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:32.468531 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6ec25d0c-b272-4c15-80c8-370fd6e41ca3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:32.474680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ec25d0c-b272-4c15-80c8-370fd6e41ca3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:32.475129 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ec25d0c-b272-4c15-80c8-370fd6e41ca3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:32.476332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ec25d0c-b272-4c15-80c8-370fd6e41ca3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:32.477015 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ec25d0c-b272-4c15-80c8-370fd6e41ca3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:32.611616 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6ec25d0c-b272-4c15-80c8-370fd6e41ca3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:32.622112 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6ec25d0c-b272-4c15-80c8-370fd6e41ca3 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1475 microversion: 2.1 time: 0.158572 Jul 26 16:35:32.622691 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 215/420] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:32 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1475 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:33.285742 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-78ad0d90-3dbc-4089-a340-bd06e395ffc1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:33.286370 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-78ad0d90-3dbc-4089-a340-bd06e395ffc1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:33.294476 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78ad0d90-3dbc-4089-a340-bd06e395ffc1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:33.294746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78ad0d90-3dbc-4089-a340-bd06e395ffc1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:33.295725 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78ad0d90-3dbc-4089-a340-bd06e395ffc1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:33.296161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78ad0d90-3dbc-4089-a340-bd06e395ffc1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:33.314579 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:33.342134 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-f539d3cf-9bc0-43c0-8fdc-9e64e60562c4 req-33b01b09-7c14-43e7-9972-c7296f66a01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3a6262-8adc-4597-8d00-35af06cee7de", "name": "network-vif-plugged", "status": "completed", "tag": "b93e292a-28ec-4647-a984-c0d6bb8814e5"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:33.353294 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-f539d3cf-9bc0-43c0-8fdc-9e64e60562c4 req-33b01b09-7c14-43e7-9972-c7296f66a01c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:33.353971 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-f539d3cf-9bc0-43c0-8fdc-9e64e60562c4 req-33b01b09-7c14-43e7-9972-c7296f66a01c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:33.367627 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-f539d3cf-9bc0-43c0-8fdc-9e64e60562c4 req-33b01b09-7c14-43e7-9972-c7296f66a01c service nova] Creating event network-vif-plugged:b93e292a-28ec-4647-a984-c0d6bb8814e5 for instance 7b3a6262-8adc-4597-8d00-35af06cee7de on hv-cinder-85104 Jul 26 16:35:33.373238 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-f539d3cf-9bc0-43c0-8fdc-9e64e60562c4 req-33b01b09-7c14-43e7-9972-c7296f66a01c service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034774 Jul 26 16:35:33.374201 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 216/421] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:35:33.510046 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-78ad0d90-3dbc-4089-a340-bd06e395ffc1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:33.518292 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-78ad0d90-3dbc-4089-a340-bd06e395ffc1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.236604 Jul 26 16:35:33.519272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 206/422] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:33 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:33.645546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-28b0ca98-1e4f-4c3f-872d-e0fb47eccf3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:33.646258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-28b0ca98-1e4f-4c3f-872d-e0fb47eccf3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:33.654529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-28b0ca98-1e4f-4c3f-872d-e0fb47eccf3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:33.655434 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-28b0ca98-1e4f-4c3f-872d-e0fb47eccf3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:33.656499 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-28b0ca98-1e4f-4c3f-872d-e0fb47eccf3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:33.658462 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-28b0ca98-1e4f-4c3f-872d-e0fb47eccf3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:33.794402 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-28b0ca98-1e4f-4c3f-872d-e0fb47eccf3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:33.802082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-28b0ca98-1e4f-4c3f-872d-e0fb47eccf3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1475 microversion: 2.1 time: 0.161438 Jul 26 16:35:33.808375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 217/423] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:33 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1475 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:33.908591 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-a3157428-a6a6-479a-a4c1-9a014db4cc16 req-460a26a6-03a2-473c-9fe4-d84291789169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e056b84-1d84-4c83-9d54-2779af4ab7ef", "name": "network-vif-deleted", "tag": "6350c4bd-2e65-40f8-bc8a-c2ce95ef3034"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:33.918272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-a3157428-a6a6-479a-a4c1-9a014db4cc16 req-460a26a6-03a2-473c-9fe4-d84291789169 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:33.918761 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-a3157428-a6a6-479a-a4c1-9a014db4cc16 req-460a26a6-03a2-473c-9fe4-d84291789169 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:33.930783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-a3157428-a6a6-479a-a4c1-9a014db4cc16 req-460a26a6-03a2-473c-9fe4-d84291789169 service nova] Creating event network-vif-deleted:6350c4bd-2e65-40f8-bc8a-c2ce95ef3034 for instance 6e056b84-1d84-4c83-9d54-2779af4ab7ef on hv-cinder-85104 Jul 26 16:35:33.935658 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-a3157428-a6a6-479a-a4c1-9a014db4cc16 req-460a26a6-03a2-473c-9fe4-d84291789169 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031122 Jul 26 16:35:33.936325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 207/424] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:35:34.541769 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1db32e72-e6eb-4ace-b5f0-af2013bf8a5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:34.542422 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1db32e72-e6eb-4ace-b5f0-af2013bf8a5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:34.548781 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1db32e72-e6eb-4ace-b5f0-af2013bf8a5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:34.549231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1db32e72-e6eb-4ace-b5f0-af2013bf8a5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:34.550007 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1db32e72-e6eb-4ace-b5f0-af2013bf8a5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:34.550478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1db32e72-e6eb-4ace-b5f0-af2013bf8a5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:34.691382 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1db32e72-e6eb-4ace-b5f0-af2013bf8a5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:34.713944 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1db32e72-e6eb-4ace-b5f0-af2013bf8a5a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.161729 Jul 26 16:35:34.713944 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 218/425] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:34 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:34.823972 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fc2446ba-8b88-4b1e-af97-76dd23720ef5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:34.824699 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fc2446ba-8b88-4b1e-af97-76dd23720ef5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:34.831656 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc2446ba-8b88-4b1e-af97-76dd23720ef5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:34.832113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc2446ba-8b88-4b1e-af97-76dd23720ef5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:34.832960 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc2446ba-8b88-4b1e-af97-76dd23720ef5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:34.833394 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc2446ba-8b88-4b1e-af97-76dd23720ef5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:34.896796 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fc2446ba-8b88-4b1e-af97-76dd23720ef5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:34.906639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fc2446ba-8b88-4b1e-af97-76dd23720ef5 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1304 microversion: 2.1 time: 0.085397 Jul 26 16:35:34.906639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 208/426] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:34 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:35.720802 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b0178636-8905-4389-b925-3a02488740f3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:35.721733 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b0178636-8905-4389-b925-3a02488740f3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:35.728499 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b0178636-8905-4389-b925-3a02488740f3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:35.738735 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b0178636-8905-4389-b925-3a02488740f3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:35.738735 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b0178636-8905-4389-b925-3a02488740f3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:35.738735 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b0178636-8905-4389-b925-3a02488740f3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:35.871539 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b0178636-8905-4389-b925-3a02488740f3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:35.879918 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b0178636-8905-4389-b925-3a02488740f3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.163321 Jul 26 16:35:35.880509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 219/427] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:35 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:35.926334 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-28dfc865-87e5-47ee-98d3-5d97621aa53e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:35.927191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-28dfc865-87e5-47ee-98d3-5d97621aa53e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:35.934570 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-28dfc865-87e5-47ee-98d3-5d97621aa53e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:35.935045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-28dfc865-87e5-47ee-98d3-5d97621aa53e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:35.935809 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-28dfc865-87e5-47ee-98d3-5d97621aa53e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:35.936239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-28dfc865-87e5-47ee-98d3-5d97621aa53e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:35.999574 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-28dfc865-87e5-47ee-98d3-5d97621aa53e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:36.007132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-28dfc865-87e5-47ee-98d3-5d97621aa53e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1304 microversion: 2.1 time: 0.085052 Jul 26 16:35:36.007684 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 209/428] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:35 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:35:36.902100 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1c6bdcaf-a2d5-4350-94ab-b1513b9167f2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:36.902707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1c6bdcaf-a2d5-4350-94ab-b1513b9167f2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:36.904695 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=10 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:36.909594 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1c6bdcaf-a2d5-4350-94ab-b1513b9167f2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:36.910049 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1c6bdcaf-a2d5-4350-94ab-b1513b9167f2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:36.910820 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1c6bdcaf-a2d5-4350-94ab-b1513b9167f2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:36.911249 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1c6bdcaf-a2d5-4350-94ab-b1513b9167f2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:37.027335 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:37.028091 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:37.035153 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:37.035682 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:37.036640 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:37.037144 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:37.046239 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1c6bdcaf-a2d5-4350-94ab-b1513b9167f2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:37.053880 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1c6bdcaf-a2d5-4350-94ab-b1513b9167f2 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1375 microversion: 2.1 time: 0.156868 Jul 26 16:35:37.054961 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 220/429] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:36 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:37.069018 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:37.069470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:37.069932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lazy-loading 'fault' on Instance uuid 6e056b84-1d84-4c83-9d54-2779af4ab7ef {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:35:37.121873 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:37.129584 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-04810f89-f594-4bfe-b471-b5275b63f96b tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1309 microversion: 2.1 time: 0.106143 Jul 26 16:35:37.130179 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 210/430] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:37 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:38.081621 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5f3b8c73-dd1c-4324-8bde-d1e524af4928 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:38.081621 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5f3b8c73-dd1c-4324-8bde-d1e524af4928 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:38.082986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f3b8c73-dd1c-4324-8bde-d1e524af4928 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:38.083445 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f3b8c73-dd1c-4324-8bde-d1e524af4928 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:38.084227 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f3b8c73-dd1c-4324-8bde-d1e524af4928 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:38.084698 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f3b8c73-dd1c-4324-8bde-d1e524af4928 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:38.152053 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:38.152703 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:38.160345 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:38.160834 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:38.161618 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:38.162057 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:38.196233 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:38.196712 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:38.197167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lazy-loading 'fault' on Instance uuid 6e056b84-1d84-4c83-9d54-2779af4ab7ef {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:35:38.232130 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5f3b8c73-dd1c-4324-8bde-d1e524af4928 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:38.249909 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75c919b5c8624a2ebad5bff722a3ff11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcbae11ef93f4951a3bc244ef9fd7a05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:35:38.250052 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5f3b8c73-dd1c-4324-8bde-d1e524af4928 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1569 microversion: 2.1 time: 0.171597 Jul 26 16:35:38.250052 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 221/431] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:38 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:38.252033 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4a0b5823-1b9b-4827-afd0-e6143fa22426 tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 200 len: 1309 microversion: 2.1 time: 0.104345 Jul 26 16:35:38.264033 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 211/432] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:38 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:35:38.268254 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ea9b8f85-8347-4165-89c5-f3be995688bb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:38.270260 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ea9b8f85-8347-4165-89c5-f3be995688bb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:38.277295 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea9b8f85-8347-4165-89c5-f3be995688bb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:38.277755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea9b8f85-8347-4165-89c5-f3be995688bb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:38.278542 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea9b8f85-8347-4165-89c5-f3be995688bb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:38.278977 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea9b8f85-8347-4165-89c5-f3be995688bb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:38.367303 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ea9b8f85-8347-4165-89c5-f3be995688bb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104831 Jul 26 16:35:38.367992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 222/433] 10.222.0.144 () {58 vars in 1280 bytes} [Tue Jul 26 16:35:38 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:35:39.275791 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2557d746-2a2a-412d-b0b3-7b7ca7af9c3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:35:39.276568 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2557d746-2a2a-412d-b0b3-7b7ca7af9c3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] [instance: 6e056b84-1d84-4c83-9d54-2779af4ab7ef] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:35:39.283219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2557d746-2a2a-412d-b0b3-7b7ca7af9c3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:39.283675 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2557d746-2a2a-412d-b0b3-7b7ca7af9c3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:39.284541 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2557d746-2a2a-412d-b0b3-7b7ca7af9c3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:39.284983 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2557d746-2a2a-412d-b0b3-7b7ca7af9c3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:39.301493 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-2557d746-2a2a-412d-b0b3-7b7ca7af9c3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] HTTP exception thrown: Instance 6e056b84-1d84-4c83-9d54-2779af4ab7ef could not be found. Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2557d746-2a2a-412d-b0b3-7b7ca7af9c3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Request method failure captured: Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef HTTP/1.1 Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BeoVXfaVMo9aekY7V9qTeHKUJ6Yr7s0n-CCVoG-OwNGGZghbTmEw-rE6ZfvgiI2wD4UNAe5k2JRSWIV_KWS9jAp5txHx2yl7SZlSOUpwf0QnCmrfMwg3vl4n9OCK67O-FquhkvbSckQLiutkXBNFptGKhdpQoRj0oGXdJ5bXLw6E08 Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: fcbae11ef93f4951a3bc244ef9fd7a05 Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-VolumesNegativeTest-1832782390 Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:35:39.303163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/fcbae11ef93f4951a3bc244ef9fd7a05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/fcbae11ef93f4951a3bc244ef9fd7a05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/fcbae11ef93f4951a3bc244ef9fd7a05"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_fcbae11ef93f4951a3bc244ef9fd7a05", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-VolumesNegativeTest-1832782390 Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: fcbae11ef93f4951a3bc244ef9fd7a05 Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-VolumesNegativeTest-1832782390 Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-VolumesNegativeTest-1832782390-project Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 75c919b5c8624a2ebad5bff722a3ff11 Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-VolumesNegativeTest-1832782390-project Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 6e056b84-1d84-4c83-9d54-2779af4ab7ef could not be found. Jul 26 16:35:39.305037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '6e056b84-1d84-4c83-9d54-2779af4ab7ef'} Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e056b84-1d84-4c83-9d54-2779af4ab7ef could not be found. Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:35:39.305782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e056b84-1d84-4c83-9d54-2779af4ab7ef could not be found. Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e056b84-1d84-4c83-9d54-2779af4ab7ef could not be found. Jul 26 16:35:39.307082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:35:39.308141 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2557d746-2a2a-412d-b0b3-7b7ca7af9c3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] Returning 404 to user: Instance 6e056b84-1d84-4c83-9d54-2779af4ab7ef could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:35:39.308141 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2557d746-2a2a-412d-b0b3-7b7ca7af9c3e tempest-VolumesNegativeTest-1832782390 tempest-VolumesNegativeTest-1832782390-project] 10.222.0.144 "GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef" status: 404 len: 111 microversion: 2.1 time: 0.033503 Jul 26 16:35:39.308141 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 212/434] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:35:39 2022] GET /compute/v2.1/servers/6e056b84-1d84-4c83-9d54-2779af4ab7ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:35:39.868801 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-679e0126-5556-4614-b847-8861bd03779d req-eb661e3a-5fe9-4d5b-b111-392ad1652af6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3a6262-8adc-4597-8d00-35af06cee7de", "tag": "b93e292a-28ec-4647-a984-c0d6bb8814e5"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:39.885849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-679e0126-5556-4614-b847-8861bd03779d req-eb661e3a-5fe9-4d5b-b111-392ad1652af6 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:39.886507 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-679e0126-5556-4614-b847-8861bd03779d req-eb661e3a-5fe9-4d5b-b111-392ad1652af6 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:39.905219 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-679e0126-5556-4614-b847-8861bd03779d req-eb661e3a-5fe9-4d5b-b111-392ad1652af6 service nova] Creating event network-changed:b93e292a-28ec-4647-a984-c0d6bb8814e5 for instance 7b3a6262-8adc-4597-8d00-35af06cee7de on hv-cinder-85104 Jul 26 16:35:39.911760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-679e0126-5556-4614-b847-8861bd03779d req-eb661e3a-5fe9-4d5b-b111-392ad1652af6 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052033 Jul 26 16:35:39.913142 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 223/435] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:35:58.339761 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-532618577", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-760029829", "security_groups": [{"name": "tempest-secgroup-smoke-1148719849"}], "networks": [{"uuid": "eda241b2-9383-4452-bdb4-3c8aafbf90be"}], "block_device_mapping_v2": [{"uuid": "efc3c278-aabd-42e1-8149-cfe5727c00af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:35:58.350181 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:58.350921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=34 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:35:58.463522 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.network.neutron [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] validate_networks() for [('eda241b2-9383-4452-bdb4-3c8aafbf90be', None, None, None, None, None)] {{(pid=124820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:35:58.843982 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Flavor limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:35:58.844442 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Image limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:35:58.844913 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Flavor pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:35:58.845318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Image pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:35:58.845731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:35:58.855564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:58.856009 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:58.856844 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:35:58.857285 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:35:58.874089 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Getting quotas for project 22e3bf7bb6ef4ca8bb2353bdfe4e90a3. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:35:58.878724 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Getting quotas for user 3b089f2cc22449329110fd3cfafecd53 and project 22e3bf7bb6ef4ca8bb2353bdfe4e90a3. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:35:58.935157 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Going to run 1 instances... {{(pid=124820) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:35:58.937388 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='efc3c278-aabd-42e1-8149-cfe5727c00af',volume_size=None,volume_type=None)] {{(pid=124820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:35:59.553877 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [61b485ad-abe2-46ca-806b-b8e1f40ad1bc] AMQP server on 10.222.0.144:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 16:36:00.312003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:00.313336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=54 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:00.317434 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fdd8cbbe-18ba-4421-bac9-78e7ee900d60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:00.318008 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fdd8cbbe-18ba-4421-bac9-78e7ee900d60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:00.324055 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fdd8cbbe-18ba-4421-bac9-78e7ee900d60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:00.325086 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fdd8cbbe-18ba-4421-bac9-78e7ee900d60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:00.325292 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fdd8cbbe-18ba-4421-bac9-78e7ee900d60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:00.325726 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fdd8cbbe-18ba-4421-bac9-78e7ee900d60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:00.348697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fdd8cbbe-18ba-4421-bac9-78e7ee900d60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/ips" status: 200 len: 149 microversion: 2.1 time: 0.037724 Jul 26 16:36:00.349266 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 224/436] 10.222.0.144 () {58 vars in 1253 bytes} [Tue Jul 26 16:36:00 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:36:00.565284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [61b485ad-abe2-46ca-806b-b8e1f40ad1bc] Reconnected to AMQP server on 10.222.0.144:5672 via [amqp] client with port 59558. Jul 26 16:36:00.571237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1b17482b-cc55-4880-b5af-96d025931418 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.235373 Jul 26 16:36:00.571880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 213/437] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:35:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 2237 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 26 16:36:00.583939 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4db089c7-fa1e-4a71-8206-1df94c00354e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:00.585303 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4db089c7-fa1e-4a71-8206-1df94c00354e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:00.655363 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4db089c7-fa1e-4a71-8206-1df94c00354e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:00.658506 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4db089c7-fa1e-4a71-8206-1df94c00354e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1090 microversion: 2.1 time: 0.079085 Jul 26 16:36:00.668891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 225/438] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:00 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1090 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:01.680480 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-79bb12b6-a33e-4b42-bb43-2cfe877cf812 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:01.681102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-79bb12b6-a33e-4b42-bb43-2cfe877cf812 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:01.737564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-79bb12b6-a33e-4b42-bb43-2cfe877cf812 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:01.744312 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-79bb12b6-a33e-4b42-bb43-2cfe877cf812 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1090 microversion: 2.1 time: 0.068179 Jul 26 16:36:01.748574 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 214/439] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:01 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1090 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:02.765317 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3948fa03-2bc2-4048-b479-965ae7895b31 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:02.766412 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3948fa03-2bc2-4048-b479-965ae7895b31 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:02.772800 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3948fa03-2bc2-4048-b479-965ae7895b31 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:02.773404 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3948fa03-2bc2-4048-b479-965ae7895b31 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:02.774211 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3948fa03-2bc2-4048-b479-965ae7895b31 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:02.774668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3948fa03-2bc2-4048-b479-965ae7895b31 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:02.837011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3948fa03-2bc2-4048-b479-965ae7895b31 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:02.845129 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3948fa03-2bc2-4048-b479-965ae7895b31 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1132 microversion: 2.1 time: 0.083693 Jul 26 16:36:02.845878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 226/440] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:02 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1132 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:03.350617 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e7539c03-6509-486f-9118-fbeae28882cf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37a87f89-6610-406c-b02c-2d4164d51538"}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:03.353082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e7539c03-6509-486f-9118-fbeae28882cf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:03.361173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e7539c03-6509-486f-9118-fbeae28882cf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:03.361618 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e7539c03-6509-486f-9118-fbeae28882cf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:03.362431 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e7539c03-6509-486f-9118-fbeae28882cf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:03.362866 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e7539c03-6509-486f-9118-fbeae28882cf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:03.865925 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0ac4baf6-0f74-4ed4-843d-e008df977d49 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:03.866535 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0ac4baf6-0f74-4ed4-843d-e008df977d49 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:03.872991 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0ac4baf6-0f74-4ed4-843d-e008df977d49 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:03.873434 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0ac4baf6-0f74-4ed4-843d-e008df977d49 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:03.874193 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0ac4baf6-0f74-4ed4-843d-e008df977d49 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:03.874627 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0ac4baf6-0f74-4ed4-843d-e008df977d49 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:03.936578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0ac4baf6-0f74-4ed4-843d-e008df977d49 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:03.944351 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0ac4baf6-0f74-4ed4-843d-e008df977d49 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1188 microversion: 2.1 time: 0.082302 Jul 26 16:36:03.944988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 227/441] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:03 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1188 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:36:04.763325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e7539c03-6509-486f-9118-fbeae28882cf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.417164 Jul 26 16:36:04.772898 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 215/442] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:36:03 2022] POST /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-volume_attachments => generated 194 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:36:04.965749 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-59d5c2a9-c537-4329-93ce-c7bba448b2f9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:04.966361 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-59d5c2a9-c537-4329-93ce-c7bba448b2f9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:04.973064 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59d5c2a9-c537-4329-93ce-c7bba448b2f9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:04.973514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59d5c2a9-c537-4329-93ce-c7bba448b2f9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:04.974325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59d5c2a9-c537-4329-93ce-c7bba448b2f9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:04.974759 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59d5c2a9-c537-4329-93ce-c7bba448b2f9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:05.131020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-59d5c2a9-c537-4329-93ce-c7bba448b2f9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:05.138561 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-59d5c2a9-c537-4329-93ce-c7bba448b2f9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1274 microversion: 2.1 time: 0.176622 Jul 26 16:36:05.140298 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 228/443] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:04 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:06.012289 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-ce12d85a-d36c-4c43-bc64-8b125e7090f4 req-5af5d5cb-fb64-44bc-9963-de4295649e8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976970b3-530e-4bc0-a609-bc3d8ac750a8", "tag": "e562fcc8-f654-4575-a60e-9fafbe61bfee"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:06.040006 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-ce12d85a-d36c-4c43-bc64-8b125e7090f4 req-5af5d5cb-fb64-44bc-9963-de4295649e8d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:06.040006 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-ce12d85a-d36c-4c43-bc64-8b125e7090f4 req-5af5d5cb-fb64-44bc-9963-de4295649e8d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:06.048489 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-ce12d85a-d36c-4c43-bc64-8b125e7090f4 req-5af5d5cb-fb64-44bc-9963-de4295649e8d service nova] Creating event network-changed:e562fcc8-f654-4575-a60e-9fafbe61bfee for instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 on hv-cinder-85104 Jul 26 16:36:06.056874 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-ce12d85a-d36c-4c43-bc64-8b125e7090f4 req-5af5d5cb-fb64-44bc-9963-de4295649e8d service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052732 Jul 26 16:36:06.057985 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 216/444] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:36:06.163198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-222ef6a7-2203-40c8-8e54-492499c3c1e5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:06.164405 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-222ef6a7-2203-40c8-8e54-492499c3c1e5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:06.171354 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-222ef6a7-2203-40c8-8e54-492499c3c1e5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:06.172176 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-222ef6a7-2203-40c8-8e54-492499c3c1e5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:06.173074 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-222ef6a7-2203-40c8-8e54-492499c3c1e5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:06.173576 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-222ef6a7-2203-40c8-8e54-492499c3c1e5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:06.314757 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-222ef6a7-2203-40c8-8e54-492499c3c1e5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:06.322734 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-222ef6a7-2203-40c8-8e54-492499c3c1e5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1274 microversion: 2.1 time: 0.164306 Jul 26 16:36:06.323306 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 229/445] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:06 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1274 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:07.345729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e8cd82d2-7cf1-47da-b3b8-43e7bdb924df tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:07.346322 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e8cd82d2-7cf1-47da-b3b8-43e7bdb924df tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:07.352533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8cd82d2-7cf1-47da-b3b8-43e7bdb924df tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:07.352985 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8cd82d2-7cf1-47da-b3b8-43e7bdb924df tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:07.353743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8cd82d2-7cf1-47da-b3b8-43e7bdb924df tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:07.354182 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8cd82d2-7cf1-47da-b3b8-43e7bdb924df tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:07.487780 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e8cd82d2-7cf1-47da-b3b8-43e7bdb924df tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:07.495334 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e8cd82d2-7cf1-47da-b3b8-43e7bdb924df tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.154293 Jul 26 16:36:07.495898 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 217/446] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:07 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:08.517330 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-76d3d4ca-c3d4-4d25-a937-a33df4d65810 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:08.517933 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-76d3d4ca-c3d4-4d25-a937-a33df4d65810 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:08.524203 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-76d3d4ca-c3d4-4d25-a937-a33df4d65810 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:08.524670 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-76d3d4ca-c3d4-4d25-a937-a33df4d65810 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:08.525435 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-76d3d4ca-c3d4-4d25-a937-a33df4d65810 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:08.525851 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-76d3d4ca-c3d4-4d25-a937-a33df4d65810 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:08.653522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-76d3d4ca-c3d4-4d25-a937-a33df4d65810 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:08.660893 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-76d3d4ca-c3d4-4d25-a937-a33df4d65810 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.148071 Jul 26 16:36:08.661446 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 230/447] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:08 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:08.749053 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-708913fb-de70-4c43-8cfa-eb5806139b45 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:08.749540 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-708913fb-de70-4c43-8cfa-eb5806139b45 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:08.756453 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-708913fb-de70-4c43-8cfa-eb5806139b45 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:08.756909 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-708913fb-de70-4c43-8cfa-eb5806139b45 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:08.757660 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-708913fb-de70-4c43-8cfa-eb5806139b45 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:08.758088 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-708913fb-de70-4c43-8cfa-eb5806139b45 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:08.780088 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-708913fb-de70-4c43-8cfa-eb5806139b45 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/ips" status: 200 len: 145 microversion: 2.1 time: 0.034947 Jul 26 16:36:08.780661 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 218/448] 10.222.0.144 () {58 vars in 1253 bytes} [Tue Jul 26 16:36:08 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/ips => generated 145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:36:09.682312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-16e368ce-6a0d-4f8d-a6c8-80ebd1111da6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:09.683102 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-16e368ce-6a0d-4f8d-a6c8-80ebd1111da6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:09.689672 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-16e368ce-6a0d-4f8d-a6c8-80ebd1111da6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:09.694567 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-16e368ce-6a0d-4f8d-a6c8-80ebd1111da6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:09.694567 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-16e368ce-6a0d-4f8d-a6c8-80ebd1111da6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:09.694567 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-16e368ce-6a0d-4f8d-a6c8-80ebd1111da6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:09.822611 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-16e368ce-6a0d-4f8d-a6c8-80ebd1111da6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:09.829992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-16e368ce-6a0d-4f8d-a6c8-80ebd1111da6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.151473 Jul 26 16:36:09.830557 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 231/449] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:09 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:10.851590 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-21658d89-8f1d-49a0-9073-c2e4d6ec4ec9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:10.852167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-21658d89-8f1d-49a0-9073-c2e4d6ec4ec9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:10.854154 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:10.859356 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-21658d89-8f1d-49a0-9073-c2e4d6ec4ec9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:10.860351 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-21658d89-8f1d-49a0-9073-c2e4d6ec4ec9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:10.861125 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-21658d89-8f1d-49a0-9073-c2e4d6ec4ec9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:10.861596 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-21658d89-8f1d-49a0-9073-c2e4d6ec4ec9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:10.990815 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-21658d89-8f1d-49a0-9073-c2e4d6ec4ec9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:10.998320 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-21658d89-8f1d-49a0-9073-c2e4d6ec4ec9 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.150704 Jul 26 16:36:10.998888 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 219/450] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:10 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:12.018965 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a005b03b-13a1-40df-8995-ac088ede6022 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:12.019919 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a005b03b-13a1-40df-8995-ac088ede6022 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:12.021800 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:12.026807 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a005b03b-13a1-40df-8995-ac088ede6022 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:12.027289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a005b03b-13a1-40df-8995-ac088ede6022 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:12.028090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a005b03b-13a1-40df-8995-ac088ede6022 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:12.028563 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a005b03b-13a1-40df-8995-ac088ede6022 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:12.157450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a005b03b-13a1-40df-8995-ac088ede6022 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:12.165039 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a005b03b-13a1-40df-8995-ac088ede6022 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.150563 Jul 26 16:36:12.165597 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 232/451] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:12 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:12.638976 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6fd301f8-33ce-4e98-b52d-24ea3c837b7c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d311159-3729-4b04-8936-b3d3fb42a575"}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:12.641901 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6fd301f8-33ce-4e98-b52d-24ea3c837b7c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:12.643760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=8 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:12.649407 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6fd301f8-33ce-4e98-b52d-24ea3c837b7c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:12.649951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6fd301f8-33ce-4e98-b52d-24ea3c837b7c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:12.650722 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6fd301f8-33ce-4e98-b52d-24ea3c837b7c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:12.651159 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6fd301f8-33ce-4e98-b52d-24ea3c837b7c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:13.185173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-32d1882c-8f4c-444e-b7d3-daf3c99c9a80 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:13.185781 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-32d1882c-8f4c-444e-b7d3-daf3c99c9a80 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:13.192007 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32d1882c-8f4c-444e-b7d3-daf3c99c9a80 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:13.192490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32d1882c-8f4c-444e-b7d3-daf3c99c9a80 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:13.193248 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32d1882c-8f4c-444e-b7d3-daf3c99c9a80 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:13.193683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32d1882c-8f4c-444e-b7d3-daf3c99c9a80 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:13.325637 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-32d1882c-8f4c-444e-b7d3-daf3c99c9a80 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:13.333601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-32d1882c-8f4c-444e-b7d3-daf3c99c9a80 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.152618 Jul 26 16:36:13.334182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 233/452] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:13 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:36:14.355004 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c4994683-845a-4b2c-9d00-44773b730711 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:14.355634 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c4994683-845a-4b2c-9d00-44773b730711 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:14.362061 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c4994683-845a-4b2c-9d00-44773b730711 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:14.362504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c4994683-845a-4b2c-9d00-44773b730711 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:14.363249 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c4994683-845a-4b2c-9d00-44773b730711 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:14.363674 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c4994683-845a-4b2c-9d00-44773b730711 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:14.403018 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6fd301f8-33ce-4e98-b52d-24ea3c837b7c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.767721 Jul 26 16:36:14.403615 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 220/453] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:36:12 2022] POST /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/os-volume_attachments => generated 194 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:36:14.497807 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c4994683-845a-4b2c-9d00-44773b730711 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:14.505338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c4994683-845a-4b2c-9d00-44773b730711 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.154270 Jul 26 16:36:14.505909 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 234/454] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:14 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:15.526727 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-58fbb45b-7d93-45a1-9987-2c688fdc4eb1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:15.527540 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-58fbb45b-7d93-45a1-9987-2c688fdc4eb1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:15.534542 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58fbb45b-7d93-45a1-9987-2c688fdc4eb1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:15.542478 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58fbb45b-7d93-45a1-9987-2c688fdc4eb1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:15.542478 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58fbb45b-7d93-45a1-9987-2c688fdc4eb1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:15.542478 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-58fbb45b-7d93-45a1-9987-2c688fdc4eb1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:15.662526 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-217934b0-cb85-43fe-99ae-9c9cf0edb471 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: .version_select at 0x7f4b6c4d6940>, body: {"keypair": {"name": "tempest-keypair-1020052871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjj1HuUKrxx/Is2rei19v813TvM/oD11gsSSdPJcYuA24iCRN5UkgZnjInJlkSZ/M1kUJDdKPjRmfeeP8Qpl1zeLR9gm+k86BlsbkakCFETVjLTld5DKKV+qzT+FnNYUg=="}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:15.677006 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-58fbb45b-7d93-45a1-9987-2c688fdc4eb1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:15.679168 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-217934b0-cb85-43fe-99ae-9c9cf0edb471 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for project 8bb1d794693b410d8c759796d5e20281. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:36:15.683258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-217934b0-cb85-43fe-99ae-9c9cf0edb471 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for user 4c6fffcc3c0d4c49848fa6c2f6b90130 and project 8bb1d794693b410d8c759796d5e20281. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:36:15.684582 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-58fbb45b-7d93-45a1-9987-2c688fdc4eb1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.161883 Jul 26 16:36:15.685136 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 221/455] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:15 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:15.805095 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-217934b0-cb85-43fe-99ae-9c9cf0edb471 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146398 Jul 26 16:36:15.805650 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 235/456] 10.222.0.144 () {60 vars in 1164 bytes} [Tue Jul 26 16:36:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:36:16.706478 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0049e422-8fbe-4799-9821-93de12c3a51f tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:16.707145 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0049e422-8fbe-4799-9821-93de12c3a51f tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:16.713620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0049e422-8fbe-4799-9821-93de12c3a51f tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:16.714066 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0049e422-8fbe-4799-9821-93de12c3a51f tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:16.714820 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0049e422-8fbe-4799-9821-93de12c3a51f tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:16.715248 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0049e422-8fbe-4799-9821-93de12c3a51f tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:16.863813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0049e422-8fbe-4799-9821-93de12c3a51f tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:16.871272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0049e422-8fbe-4799-9821-93de12c3a51f tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.169366 Jul 26 16:36:16.871827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 222/457] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:16 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:17.893417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2a494bab-ef4f-448c-aa8b-2334d788779e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:17.894125 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2a494bab-ef4f-448c-aa8b-2334d788779e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:17.900365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2a494bab-ef4f-448c-aa8b-2334d788779e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:17.909403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2a494bab-ef4f-448c-aa8b-2334d788779e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:17.909403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2a494bab-ef4f-448c-aa8b-2334d788779e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:17.909403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2a494bab-ef4f-448c-aa8b-2334d788779e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:18.031652 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2a494bab-ef4f-448c-aa8b-2334d788779e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:18.039321 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2a494bab-ef4f-448c-aa8b-2334d788779e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.150763 Jul 26 16:36:18.039885 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 236/458] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:17 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:18.427320 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1303864365", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fec62f0-42f9-4a76-8f36-14730e310aa9"}], "security_groups": [{"name": "tempest-securitygroup--1507432165"}], "key_name": "tempest-keypair-1020052871", "user_data": "}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:18.530732 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.network.neutron [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] validate_networks() for [('7fec62f0-42f9-4a76-8f36-14730e310aa9', None, None, None, None, None)] {{(pid=124820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:36:18.895672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Flavor limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:36:18.896088 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Image limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:36:18.896606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Flavor pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:36:18.897010 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Image pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:36:18.897446 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:36:18.906289 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:18.907232 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:18.908015 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:18.908482 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:18.925247 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for project 8bb1d794693b410d8c759796d5e20281. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:36:18.929128 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for user 4c6fffcc3c0d4c49848fa6c2f6b90130 and project 8bb1d794693b410d8c759796d5e20281. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:36:18.939765 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Going to run 1 instances... {{(pid=124820) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:36:18.941964 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:36:19.060025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1affe030-dbc0-478a-8541-4ece07ba2a29 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:19.060660 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1affe030-dbc0-478a-8541-4ece07ba2a29 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:19.066706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1affe030-dbc0-478a-8541-4ece07ba2a29 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:19.067160 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1affe030-dbc0-478a-8541-4ece07ba2a29 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:19.067923 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1affe030-dbc0-478a-8541-4ece07ba2a29 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:19.068360 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1affe030-dbc0-478a-8541-4ece07ba2a29 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:19.085121 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0203faf1-a0d4-4ebd-97c2-2688ca7569c0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.662771 Jul 26 16:36:19.085921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 223/459] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:36:18 2022] POST /compute/v2.1/servers => generated 404 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:36:19.096892 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3da4e9c8-8a43-4a64-a8f5-0435b00ed0a2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:19.097502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3da4e9c8-8a43-4a64-a8f5-0435b00ed0a2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:19.153144 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3da4e9c8-8a43-4a64-a8f5-0435b00ed0a2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:19.160840 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3da4e9c8-8a43-4a64-a8f5-0435b00ed0a2 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1246 microversion: 2.1 time: 0.068169 Jul 26 16:36:19.161699 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 224/460] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:19 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1246 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:19.222317 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1affe030-dbc0-478a-8541-4ece07ba2a29 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:19.230390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1affe030-dbc0-478a-8541-4ece07ba2a29 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.174067 Jul 26 16:36:19.230988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 237/461] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:19 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:36:20.123955 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-7df1130a-ce1d-4dd2-93e4-64c2e772ec54 req-2dc2f200-5e0a-4736-8f4c-985ac65fdb9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976970b3-530e-4bc0-a609-bc3d8ac750a8", "name": "network-vif-plugged", "status": "completed", "tag": "e562fcc8-f654-4575-a60e-9fafbe61bfee"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:20.134411 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-7df1130a-ce1d-4dd2-93e4-64c2e772ec54 req-2dc2f200-5e0a-4736-8f4c-985ac65fdb9d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:20.134850 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-7df1130a-ce1d-4dd2-93e4-64c2e772ec54 req-2dc2f200-5e0a-4736-8f4c-985ac65fdb9d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:20.146758 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-7df1130a-ce1d-4dd2-93e4-64c2e772ec54 req-2dc2f200-5e0a-4736-8f4c-985ac65fdb9d service nova] Creating event network-vif-plugged:e562fcc8-f654-4575-a60e-9fafbe61bfee for instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 on hv-cinder-85104 Jul 26 16:36:20.151989 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-7df1130a-ce1d-4dd2-93e4-64c2e772ec54 req-2dc2f200-5e0a-4736-8f4c-985ac65fdb9d service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031660 Jul 26 16:36:20.152638 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 225/462] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:36:20.182090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-66d35978-14db-418e-983f-10334419ce58 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:20.182727 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-66d35978-14db-418e-983f-10334419ce58 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:20.188909 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-66d35978-14db-418e-983f-10334419ce58 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:20.189349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-66d35978-14db-418e-983f-10334419ce58 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:20.190136 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-66d35978-14db-418e-983f-10334419ce58 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:20.190561 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-66d35978-14db-418e-983f-10334419ce58 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:20.253063 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c303d532-8fa1-4aa2-9ec5-64f542d89792 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:20.254792 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c303d532-8fa1-4aa2-9ec5-64f542d89792 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:20.256296 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-66d35978-14db-418e-983f-10334419ce58 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:20.261670 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c303d532-8fa1-4aa2-9ec5-64f542d89792 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:20.262122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c303d532-8fa1-4aa2-9ec5-64f542d89792 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:20.262876 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c303d532-8fa1-4aa2-9ec5-64f542d89792 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:20.263470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c303d532-8fa1-4aa2-9ec5-64f542d89792 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:20.264312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-66d35978-14db-418e-983f-10334419ce58 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1250 microversion: 2.1 time: 0.086198 Jul 26 16:36:20.265432 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 238/463] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:20 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:20.405263 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c303d532-8fa1-4aa2-9ec5-64f542d89792 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:20.412875 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c303d532-8fa1-4aa2-9ec5-64f542d89792 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.165397 Jul 26 16:36:20.413439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 226/464] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:20 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:36:21.287366 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-614c89b1-8d71-4fb4-be11-c599798e3383 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:21.287975 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-614c89b1-8d71-4fb4-be11-c599798e3383 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:21.293974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-614c89b1-8d71-4fb4-be11-c599798e3383 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:21.294426 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-614c89b1-8d71-4fb4-be11-c599798e3383 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:21.295194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-614c89b1-8d71-4fb4-be11-c599798e3383 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:21.295628 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-614c89b1-8d71-4fb4-be11-c599798e3383 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:21.355722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-614c89b1-8d71-4fb4-be11-c599798e3383 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:21.363726 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-614c89b1-8d71-4fb4-be11-c599798e3383 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1298 microversion: 2.1 time: 0.080279 Jul 26 16:36:21.364289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 239/465] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:21 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1298 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:21.434252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-496844ee-02a8-40cc-b26f-5a2a62141ead tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:21.434861 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-496844ee-02a8-40cc-b26f-5a2a62141ead tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:21.441320 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-496844ee-02a8-40cc-b26f-5a2a62141ead tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:21.441767 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-496844ee-02a8-40cc-b26f-5a2a62141ead tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:21.442524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-496844ee-02a8-40cc-b26f-5a2a62141ead tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:21.442957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-496844ee-02a8-40cc-b26f-5a2a62141ead tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:21.573087 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-496844ee-02a8-40cc-b26f-5a2a62141ead tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:21.581062 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-496844ee-02a8-40cc-b26f-5a2a62141ead tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.150627 Jul 26 16:36:21.581617 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 227/466] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:21 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:22.384409 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5e667ee5-aa1a-4fa5-9c8f-7c95c5a486ea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:22.385004 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5e667ee5-aa1a-4fa5-9c8f-7c95c5a486ea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:22.391087 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5e667ee5-aa1a-4fa5-9c8f-7c95c5a486ea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:22.391537 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5e667ee5-aa1a-4fa5-9c8f-7c95c5a486ea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:22.392300 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5e667ee5-aa1a-4fa5-9c8f-7c95c5a486ea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:22.392765 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5e667ee5-aa1a-4fa5-9c8f-7c95c5a486ea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:22.458376 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5e667ee5-aa1a-4fa5-9c8f-7c95c5a486ea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:22.465916 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5e667ee5-aa1a-4fa5-9c8f-7c95c5a486ea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1298 microversion: 2.1 time: 0.085366 Jul 26 16:36:22.466463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 240/467] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:22 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:22.602451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f2b7baa7-959f-4fb8-8a1d-998631abdb51 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:22.603041 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f2b7baa7-959f-4fb8-8a1d-998631abdb51 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:22.609482 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f2b7baa7-959f-4fb8-8a1d-998631abdb51 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:22.610491 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f2b7baa7-959f-4fb8-8a1d-998631abdb51 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:22.611275 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f2b7baa7-959f-4fb8-8a1d-998631abdb51 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:22.611702 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f2b7baa7-959f-4fb8-8a1d-998631abdb51 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:22.740217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f2b7baa7-959f-4fb8-8a1d-998631abdb51 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:22.747744 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f2b7baa7-959f-4fb8-8a1d-998631abdb51 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1262 microversion: 2.1 time: 0.149148 Jul 26 16:36:22.748301 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 228/468] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:22 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1262 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:23.486882 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4bfac53c-1092-41dc-ace3-01c897c5fd60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:23.487509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4bfac53c-1092-41dc-ace3-01c897c5fd60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:23.493654 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4bfac53c-1092-41dc-ace3-01c897c5fd60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:23.494104 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4bfac53c-1092-41dc-ace3-01c897c5fd60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:23.494868 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4bfac53c-1092-41dc-ace3-01c897c5fd60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:23.495298 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4bfac53c-1092-41dc-ace3-01c897c5fd60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:23.556253 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4bfac53c-1092-41dc-ace3-01c897c5fd60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:23.563796 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4bfac53c-1092-41dc-ace3-01c897c5fd60 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1306 microversion: 2.1 time: 0.081353 Jul 26 16:36:23.564370 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 241/469] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:23 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1306 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:23.768955 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-afdd8d0c-ff2d-453f-99f3-add138861344 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:23.769486 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-afdd8d0c-ff2d-453f-99f3-add138861344 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:23.776072 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-afdd8d0c-ff2d-453f-99f3-add138861344 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:23.776560 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-afdd8d0c-ff2d-453f-99f3-add138861344 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:23.777313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-afdd8d0c-ff2d-453f-99f3-add138861344 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:23.777742 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-afdd8d0c-ff2d-453f-99f3-add138861344 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:23.910326 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-afdd8d0c-ff2d-453f-99f3-add138861344 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:23.917851 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-afdd8d0c-ff2d-453f-99f3-add138861344 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1447 microversion: 2.1 time: 0.153392 Jul 26 16:36:23.918405 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 229/470] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:23 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:23.939656 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2ecc27b0-1a87-4d6e-90e4-4277acd1b93d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:23.940415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2ecc27b0-1a87-4d6e-90e4-4277acd1b93d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:23.946494 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2ecc27b0-1a87-4d6e-90e4-4277acd1b93d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:23.946927 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2ecc27b0-1a87-4d6e-90e4-4277acd1b93d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:23.947704 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2ecc27b0-1a87-4d6e-90e4-4277acd1b93d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:23.948138 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2ecc27b0-1a87-4d6e-90e4-4277acd1b93d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:24.086941 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2ecc27b0-1a87-4d6e-90e4-4277acd1b93d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:24.089888 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:24.096054 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2ecc27b0-1a87-4d6e-90e4-4277acd1b93d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1447 microversion: 2.1 time: 0.160300 Jul 26 16:36:24.100435 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 242/471] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:23 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:24.584729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f947d4b2-d395-4c9f-a28c-c9ddeeed5536 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:24.586533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f947d4b2-d395-4c9f-a28c-c9ddeeed5536 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:24.595376 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f947d4b2-d395-4c9f-a28c-c9ddeeed5536 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:24.596620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f947d4b2-d395-4c9f-a28c-c9ddeeed5536 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:24.597401 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f947d4b2-d395-4c9f-a28c-c9ddeeed5536 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:24.597880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f947d4b2-d395-4c9f-a28c-c9ddeeed5536 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:24.676589 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f947d4b2-d395-4c9f-a28c-c9ddeeed5536 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:24.685155 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f947d4b2-d395-4c9f-a28c-c9ddeeed5536 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1306 microversion: 2.1 time: 0.104181 Jul 26 16:36:24.685939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 230/472] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:24 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1306 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:25.707364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a95ce894-bf6d-4aee-b1ea-231d0f5883ff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:25.707965 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a95ce894-bf6d-4aee-b1ea-231d0f5883ff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:25.710388 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=4 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:25.715550 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a95ce894-bf6d-4aee-b1ea-231d0f5883ff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:25.729127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a95ce894-bf6d-4aee-b1ea-231d0f5883ff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:25.729127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a95ce894-bf6d-4aee-b1ea-231d0f5883ff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:25.729127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a95ce894-bf6d-4aee-b1ea-231d0f5883ff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:25.849509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a95ce894-bf6d-4aee-b1ea-231d0f5883ff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:25.857030 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a95ce894-bf6d-4aee-b1ea-231d0f5883ff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.155015 Jul 26 16:36:25.857605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 243/473] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:25 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:26.198784 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-109ff506-6663-4f17-9b7f-21d00f66390c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:26.206222 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-109ff506-6663-4f17-9b7f-21d00f66390c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:26.206676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-109ff506-6663-4f17-9b7f-21d00f66390c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:26.274739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-109ff506-6663-4f17-9b7f-21d00f66390c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Going to try to stop instance {{(pid=124820) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 16:36:26.280339 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:26.521658 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-109ff506-6663-4f17-9b7f-21d00f66390c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/action" status: 202 len: 0 microversion: 2.1 time: 0.326407 Jul 26 16:36:26.523199 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 231/474] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:36:26 2022] POST /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:36:26.528052 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-251f9f04-cd8d-4ed2-ac98-a14ee73d1a05 req-d0594ebb-1b91-4adb-bc18-1b12128843f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178c5e10-8273-4f85-8802-ab643a1c9b6d", "tag": "1b0b636e-41d7-4e36-912a-bf842602d0ee"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:26.545449 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-251f9f04-cd8d-4ed2-ac98-a14ee73d1a05 req-d0594ebb-1b91-4adb-bc18-1b12128843f5 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:26.546165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-251f9f04-cd8d-4ed2-ac98-a14ee73d1a05 req-d0594ebb-1b91-4adb-bc18-1b12128843f5 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:26.547349 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9662bf6c-3313-4699-8620-40c7f98b3884 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:26.548171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9662bf6c-3313-4699-8620-40c7f98b3884 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:26.558885 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9662bf6c-3313-4699-8620-40c7f98b3884 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:26.559241 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-251f9f04-cd8d-4ed2-ac98-a14ee73d1a05 req-d0594ebb-1b91-4adb-bc18-1b12128843f5 service nova] Creating event network-changed:1b0b636e-41d7-4e36-912a-bf842602d0ee for instance 178c5e10-8273-4f85-8802-ab643a1c9b6d on hv-cinder-85104 Jul 26 16:36:26.559823 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9662bf6c-3313-4699-8620-40c7f98b3884 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:26.560876 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9662bf6c-3313-4699-8620-40c7f98b3884 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:26.561531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9662bf6c-3313-4699-8620-40c7f98b3884 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:26.571967 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-251f9f04-cd8d-4ed2-ac98-a14ee73d1a05 req-d0594ebb-1b91-4adb-bc18-1b12128843f5 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047482 Jul 26 16:36:26.572603 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 244/475] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:36:26.651489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-c5857622-79e3-4f97-8251-23bb3cf58ec6 req-91281d81-fccb-4fb6-acba-eb044c50d301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976970b3-530e-4bc0-a609-bc3d8ac750a8", "tag": "e562fcc8-f654-4575-a60e-9fafbe61bfee"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:26.662326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-c5857622-79e3-4f97-8251-23bb3cf58ec6 req-91281d81-fccb-4fb6-acba-eb044c50d301 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:26.663043 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-c5857622-79e3-4f97-8251-23bb3cf58ec6 req-91281d81-fccb-4fb6-acba-eb044c50d301 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:26.678440 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-c5857622-79e3-4f97-8251-23bb3cf58ec6 req-91281d81-fccb-4fb6-acba-eb044c50d301 service nova] Creating event network-changed:e562fcc8-f654-4575-a60e-9fafbe61bfee for instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 on hv-cinder-85104 Jul 26 16:36:26.693385 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-c5857622-79e3-4f97-8251-23bb3cf58ec6 req-91281d81-fccb-4fb6-acba-eb044c50d301 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045532 Jul 26 16:36:26.694112 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 245/476] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:36:26.780473 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9662bf6c-3313-4699-8620-40c7f98b3884 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:26.789244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9662bf6c-3313-4699-8620-40c7f98b3884 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1726 microversion: 2.1 time: 0.262028 Jul 26 16:36:26.789743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 232/477] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:26 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1726 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:26.879797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-26e6dfec-97cf-4660-acfc-facc575c3825 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:26.881285 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-26e6dfec-97cf-4660-acfc-facc575c3825 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:26.888059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-26e6dfec-97cf-4660-acfc-facc575c3825 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:26.889452 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-26e6dfec-97cf-4660-acfc-facc575c3825 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:26.890191 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-26e6dfec-97cf-4660-acfc-facc575c3825 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:26.890625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-26e6dfec-97cf-4660-acfc-facc575c3825 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:27.133707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-26e6dfec-97cf-4660-acfc-facc575c3825 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:27.146256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-26e6dfec-97cf-4660-acfc-facc575c3825 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.270389 Jul 26 16:36:27.148349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 246/478] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:26 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:27.815499 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-01ba0666-b29a-4803-a0d4-9097fccdca6e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:27.816100 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-01ba0666-b29a-4803-a0d4-9097fccdca6e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:27.823298 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-01ba0666-b29a-4803-a0d4-9097fccdca6e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:27.823740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-01ba0666-b29a-4803-a0d4-9097fccdca6e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:27.824534 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-01ba0666-b29a-4803-a0d4-9097fccdca6e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:27.824965 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-01ba0666-b29a-4803-a0d4-9097fccdca6e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:27.963567 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-01ba0666-b29a-4803-a0d4-9097fccdca6e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:27.971606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-01ba0666-b29a-4803-a0d4-9097fccdca6e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1726 microversion: 2.1 time: 0.160557 Jul 26 16:36:27.972173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 233/479] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:27 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:28.168774 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-463f9684-a012-48d2-b51b-675d27999002 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:28.169385 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-463f9684-a012-48d2-b51b-675d27999002 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:28.175904 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-463f9684-a012-48d2-b51b-675d27999002 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:28.176356 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-463f9684-a012-48d2-b51b-675d27999002 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:28.177185 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-463f9684-a012-48d2-b51b-675d27999002 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:28.177630 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-463f9684-a012-48d2-b51b-675d27999002 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:28.322513 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-463f9684-a012-48d2-b51b-675d27999002 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:28.330467 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-463f9684-a012-48d2-b51b-675d27999002 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.165447 Jul 26 16:36:28.331038 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 247/480] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:28 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:28.992969 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-37376bcd-0b39-43f1-ad7e-4369180b7346 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:28.993498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-37376bcd-0b39-43f1-ad7e-4369180b7346 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:28.996162 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:28.996851 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:29.002268 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37376bcd-0b39-43f1-ad7e-4369180b7346 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:29.002719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37376bcd-0b39-43f1-ad7e-4369180b7346 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:29.003531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37376bcd-0b39-43f1-ad7e-4369180b7346 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:29.003964 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37376bcd-0b39-43f1-ad7e-4369180b7346 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:29.133196 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-37376bcd-0b39-43f1-ad7e-4369180b7346 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:29.140972 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-37376bcd-0b39-43f1-ad7e-4369180b7346 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1726 microversion: 2.1 time: 0.151913 Jul 26 16:36:29.141543 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 234/481] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:28 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:29.351721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8c31a645-f293-4535-a840-2a7ffdafd22c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:29.352327 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8c31a645-f293-4535-a840-2a7ffdafd22c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:29.358545 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8c31a645-f293-4535-a840-2a7ffdafd22c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:29.359026 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8c31a645-f293-4535-a840-2a7ffdafd22c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:29.360373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8c31a645-f293-4535-a840-2a7ffdafd22c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:29.360862 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8c31a645-f293-4535-a840-2a7ffdafd22c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:29.491395 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8c31a645-f293-4535-a840-2a7ffdafd22c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:29.498938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8c31a645-f293-4535-a840-2a7ffdafd22c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.151107 Jul 26 16:36:29.499492 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 248/482] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:29 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:30.161581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9740cef6-3654-4a79-b8d2-95a7390f54a0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:30.162220 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9740cef6-3654-4a79-b8d2-95a7390f54a0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:30.164018 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=8 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:30.169269 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9740cef6-3654-4a79-b8d2-95a7390f54a0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:30.169726 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9740cef6-3654-4a79-b8d2-95a7390f54a0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:30.170472 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9740cef6-3654-4a79-b8d2-95a7390f54a0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:30.170902 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9740cef6-3654-4a79-b8d2-95a7390f54a0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:30.312355 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9740cef6-3654-4a79-b8d2-95a7390f54a0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:30.321074 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9740cef6-3654-4a79-b8d2-95a7390f54a0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1726 microversion: 2.1 time: 0.163362 Jul 26 16:36:30.321636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 235/483] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:30 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:30.520294 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c52b9b17-9d7c-49b7-a6a7-327f60b17380 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:30.520873 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c52b9b17-9d7c-49b7-a6a7-327f60b17380 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:30.526974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c52b9b17-9d7c-49b7-a6a7-327f60b17380 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:30.527423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c52b9b17-9d7c-49b7-a6a7-327f60b17380 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:30.528187 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c52b9b17-9d7c-49b7-a6a7-327f60b17380 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:30.528690 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c52b9b17-9d7c-49b7-a6a7-327f60b17380 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:30.666167 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c52b9b17-9d7c-49b7-a6a7-327f60b17380 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:30.674435 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c52b9b17-9d7c-49b7-a6a7-327f60b17380 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.158629 Jul 26 16:36:30.675013 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 249/484] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:30 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:31.346089 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c1049a92-10a7-4c3d-9087-c6d5276495b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:31.346693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c1049a92-10a7-4c3d-9087-c6d5276495b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:31.353267 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c1049a92-10a7-4c3d-9087-c6d5276495b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:31.353719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c1049a92-10a7-4c3d-9087-c6d5276495b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:31.354476 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c1049a92-10a7-4c3d-9087-c6d5276495b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:31.354910 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c1049a92-10a7-4c3d-9087-c6d5276495b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:31.479341 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c1049a92-10a7-4c3d-9087-c6d5276495b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:31.487378 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c1049a92-10a7-4c3d-9087-c6d5276495b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1726 microversion: 2.1 time: 0.146110 Jul 26 16:36:31.487947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 236/485] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:31 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1726 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:31.695283 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9823ad83-c5bd-4c2f-98f8-72197d858c09 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:31.695907 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9823ad83-c5bd-4c2f-98f8-72197d858c09 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:31.701998 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9823ad83-c5bd-4c2f-98f8-72197d858c09 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:31.702439 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9823ad83-c5bd-4c2f-98f8-72197d858c09 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:31.703189 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9823ad83-c5bd-4c2f-98f8-72197d858c09 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:31.703615 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9823ad83-c5bd-4c2f-98f8-72197d858c09 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:31.833391 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9823ad83-c5bd-4c2f-98f8-72197d858c09 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:31.840698 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9823ad83-c5bd-4c2f-98f8-72197d858c09 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.149357 Jul 26 16:36:31.841261 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 250/486] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:31 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:32.508000 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-692c038a-bb08-42dd-af53-52723ffc0764 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:32.508628 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-692c038a-bb08-42dd-af53-52723ffc0764 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:32.515380 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-692c038a-bb08-42dd-af53-52723ffc0764 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:32.515862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-692c038a-bb08-42dd-af53-52723ffc0764 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:32.517159 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-692c038a-bb08-42dd-af53-52723ffc0764 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:32.517590 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-692c038a-bb08-42dd-af53-52723ffc0764 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:32.649744 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-692c038a-bb08-42dd-af53-52723ffc0764 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:32.654640 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-692c038a-bb08-42dd-af53-52723ffc0764 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1726 microversion: 2.1 time: 0.150442 Jul 26 16:36:32.655214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 237/487] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:32 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:32.862337 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-53281a07-5966-44c9-89ff-b041a26e2d20 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:32.862988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-53281a07-5966-44c9-89ff-b041a26e2d20 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:32.865075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:36:32.870032 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-53281a07-5966-44c9-89ff-b041a26e2d20 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:32.870486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-53281a07-5966-44c9-89ff-b041a26e2d20 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:32.874880 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-53281a07-5966-44c9-89ff-b041a26e2d20 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:32.874880 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-53281a07-5966-44c9-89ff-b041a26e2d20 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:33.002807 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-53281a07-5966-44c9-89ff-b041a26e2d20 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:33.010286 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-53281a07-5966-44c9-89ff-b041a26e2d20 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.152358 Jul 26 16:36:33.010848 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 251/488] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:32 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:33.675518 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-992d331d-03cd-4022-ac7c-197064d49e43 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:33.676157 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-992d331d-03cd-4022-ac7c-197064d49e43 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:33.682595 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-992d331d-03cd-4022-ac7c-197064d49e43 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:33.683043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-992d331d-03cd-4022-ac7c-197064d49e43 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:33.683802 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-992d331d-03cd-4022-ac7c-197064d49e43 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:33.684232 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-992d331d-03cd-4022-ac7c-197064d49e43 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:33.819479 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-992d331d-03cd-4022-ac7c-197064d49e43 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:33.827376 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-992d331d-03cd-4022-ac7c-197064d49e43 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1726 microversion: 2.1 time: 0.156189 Jul 26 16:36:33.827933 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 238/489] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:33 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:34.031153 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-256cbe73-2d42-4bad-bee8-447299a1ec15 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:34.032208 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-256cbe73-2d42-4bad-bee8-447299a1ec15 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:34.038272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-256cbe73-2d42-4bad-bee8-447299a1ec15 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:34.038723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-256cbe73-2d42-4bad-bee8-447299a1ec15 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:34.039487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-256cbe73-2d42-4bad-bee8-447299a1ec15 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:34.039922 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-256cbe73-2d42-4bad-bee8-447299a1ec15 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:34.167708 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-256cbe73-2d42-4bad-bee8-447299a1ec15 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:34.175222 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-256cbe73-2d42-4bad-bee8-447299a1ec15 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.147952 Jul 26 16:36:34.175796 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 252/490] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:34 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:34.414784 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-4bf09796-4332-4d74-b303-54ca5977a73e req-55c46b47-9ec0-41f7-8ef9-883f4b1eae7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178c5e10-8273-4f85-8802-ab643a1c9b6d", "name": "network-vif-plugged", "status": "completed", "tag": "1b0b636e-41d7-4e36-912a-bf842602d0ee"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:34.423355 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-4bf09796-4332-4d74-b303-54ca5977a73e req-55c46b47-9ec0-41f7-8ef9-883f4b1eae7b service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:34.423803 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-4bf09796-4332-4d74-b303-54ca5977a73e req-55c46b47-9ec0-41f7-8ef9-883f4b1eae7b service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:34.434610 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-4bf09796-4332-4d74-b303-54ca5977a73e req-55c46b47-9ec0-41f7-8ef9-883f4b1eae7b service nova] Creating event network-vif-plugged:1b0b636e-41d7-4e36-912a-bf842602d0ee for instance 178c5e10-8273-4f85-8802-ab643a1c9b6d on hv-cinder-85104 Jul 26 16:36:34.439432 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-4bf09796-4332-4d74-b303-54ca5977a73e req-55c46b47-9ec0-41f7-8ef9-883f4b1eae7b service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029270 Jul 26 16:36:34.440004 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 239/491] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:36:34.849008 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-93a6af73-6e25-40dd-9edf-66a9107ecf7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:34.849544 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-93a6af73-6e25-40dd-9edf-66a9107ecf7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:34.856132 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-93a6af73-6e25-40dd-9edf-66a9107ecf7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:34.856657 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-93a6af73-6e25-40dd-9edf-66a9107ecf7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:34.857424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-93a6af73-6e25-40dd-9edf-66a9107ecf7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:34.857855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-93a6af73-6e25-40dd-9edf-66a9107ecf7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:35.127627 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-93a6af73-6e25-40dd-9edf-66a9107ecf7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:35.135429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-93a6af73-6e25-40dd-9edf-66a9107ecf7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1726 microversion: 2.1 time: 0.290412 Jul 26 16:36:35.135989 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 253/492] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:34 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1726 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:35.195855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-580b6864-7654-4233-ae6d-7c679912241f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:35.196579 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-580b6864-7654-4233-ae6d-7c679912241f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:35.202704 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-580b6864-7654-4233-ae6d-7c679912241f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:35.203153 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-580b6864-7654-4233-ae6d-7c679912241f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:35.204038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-580b6864-7654-4233-ae6d-7c679912241f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:35.204497 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-580b6864-7654-4233-ae6d-7c679912241f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:35.333309 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-580b6864-7654-4233-ae6d-7c679912241f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:35.340579 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-580b6864-7654-4233-ae6d-7c679912241f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.149305 Jul 26 16:36:35.341169 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 240/493] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:35 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:36.156935 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a6096a43-3e5f-4578-a3a5-84e40d0f7b9e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:36.157549 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a6096a43-3e5f-4578-a3a5-84e40d0f7b9e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:36.163890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a6096a43-3e5f-4578-a3a5-84e40d0f7b9e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:36.164338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a6096a43-3e5f-4578-a3a5-84e40d0f7b9e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:36.165123 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a6096a43-3e5f-4578-a3a5-84e40d0f7b9e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:36.165558 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a6096a43-3e5f-4578-a3a5-84e40d0f7b9e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:36.292270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a6096a43-3e5f-4578-a3a5-84e40d0f7b9e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:36.300705 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a6096a43-3e5f-4578-a3a5-84e40d0f7b9e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1726 microversion: 2.1 time: 0.147645 Jul 26 16:36:36.301277 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 254/494] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:36 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:36.361893 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-62d24cd4-4af2-4454-8a85-02e8ab5dd1d1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:36.362503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-62d24cd4-4af2-4454-8a85-02e8ab5dd1d1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:36.368928 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-62d24cd4-4af2-4454-8a85-02e8ab5dd1d1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:36.369381 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-62d24cd4-4af2-4454-8a85-02e8ab5dd1d1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:36.370140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-62d24cd4-4af2-4454-8a85-02e8ab5dd1d1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:36.370574 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-62d24cd4-4af2-4454-8a85-02e8ab5dd1d1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:36.511446 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-62d24cd4-4af2-4454-8a85-02e8ab5dd1d1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:36.519154 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-62d24cd4-4af2-4454-8a85-02e8ab5dd1d1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.161549 Jul 26 16:36:36.519905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 241/495] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:36 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:37.322517 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-615e6ebd-d3ab-41af-90d1-73d6b12d85e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:37.323128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-615e6ebd-d3ab-41af-90d1-73d6b12d85e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:37.329620 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-615e6ebd-d3ab-41af-90d1-73d6b12d85e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:37.330070 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-615e6ebd-d3ab-41af-90d1-73d6b12d85e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:37.330847 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-615e6ebd-d3ab-41af-90d1-73d6b12d85e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:37.331284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-615e6ebd-d3ab-41af-90d1-73d6b12d85e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:37.463044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-615e6ebd-d3ab-41af-90d1-73d6b12d85e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:37.471623 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-615e6ebd-d3ab-41af-90d1-73d6b12d85e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1726 microversion: 2.1 time: 0.152844 Jul 26 16:36:37.472519 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 255/496] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:37 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:37.539848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-aebba2af-adb0-40a8-8d0e-339008f90d8b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:37.540605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-aebba2af-adb0-40a8-8d0e-339008f90d8b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:37.547801 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aebba2af-adb0-40a8-8d0e-339008f90d8b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:37.548250 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aebba2af-adb0-40a8-8d0e-339008f90d8b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:37.549039 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aebba2af-adb0-40a8-8d0e-339008f90d8b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:37.549466 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aebba2af-adb0-40a8-8d0e-339008f90d8b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:37.726224 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-aebba2af-adb0-40a8-8d0e-339008f90d8b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:37.734103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-aebba2af-adb0-40a8-8d0e-339008f90d8b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1372 microversion: 2.1 time: 0.198197 Jul 26 16:36:37.735248 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 242/497] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:37 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:38.493331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-bcaa6835-494e-4c23-95f4-fa39b4b5f48e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:38.493930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-bcaa6835-494e-4c23-95f4-fa39b4b5f48e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:38.499858 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bcaa6835-494e-4c23-95f4-fa39b4b5f48e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:38.500378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bcaa6835-494e-4c23-95f4-fa39b4b5f48e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:38.501151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bcaa6835-494e-4c23-95f4-fa39b4b5f48e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:38.501578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bcaa6835-494e-4c23-95f4-fa39b4b5f48e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:38.627121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-bcaa6835-494e-4c23-95f4-fa39b4b5f48e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:38.635021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-bcaa6835-494e-4c23-95f4-fa39b4b5f48e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1703 microversion: 2.1 time: 0.145562 Jul 26 16:36:38.635582 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 256/498] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:38 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1703 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:38.663450 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6af477b4-1c50-4277-aede-e69384abb092 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:38.670428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6af477b4-1c50-4277-aede-e69384abb092 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:38.670902 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6af477b4-1c50-4277-aede-e69384abb092 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:38.692719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6af477b4-1c50-4277-aede-e69384abb092 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Going to try to start instance {{(pid=124820) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 16:36:38.755160 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-294143c6-ef7d-4582-bc56-e785cc782061 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:38.755710 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-294143c6-ef7d-4582-bc56-e785cc782061 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:38.761668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-294143c6-ef7d-4582-bc56-e785cc782061 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:38.762105 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-294143c6-ef7d-4582-bc56-e785cc782061 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:38.762854 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-294143c6-ef7d-4582-bc56-e785cc782061 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:38.763281 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-294143c6-ef7d-4582-bc56-e785cc782061 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:38.893308 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-294143c6-ef7d-4582-bc56-e785cc782061 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:38.901130 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-294143c6-ef7d-4582-bc56-e785cc782061 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1562 microversion: 2.1 time: 0.149879 Jul 26 16:36:38.901682 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 257/499] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:38 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:36:38.925904 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9c632fe1-b3a3-4e7e-835c-81433c195cd8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:38.926449 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9c632fe1-b3a3-4e7e-835c-81433c195cd8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:38.932061 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c632fe1-b3a3-4e7e-835c-81433c195cd8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:38.932546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c632fe1-b3a3-4e7e-835c-81433c195cd8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:38.933294 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c632fe1-b3a3-4e7e-835c-81433c195cd8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:38.933744 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c632fe1-b3a3-4e7e-835c-81433c195cd8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:38.966129 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6af477b4-1c50-4277-aede-e69384abb092 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/action" status: 202 len: 0 microversion: 2.1 time: 0.306610 Jul 26 16:36:38.966728 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 243/500] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:36:38 2022] POST /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:36:38.975751 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-51b26e04-ea1d-461e-a056-8f8c43108f65 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:38.976470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-51b26e04-ea1d-461e-a056-8f8c43108f65 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:38.982687 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51b26e04-ea1d-461e-a056-8f8c43108f65 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:38.983138 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51b26e04-ea1d-461e-a056-8f8c43108f65 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:38.983899 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51b26e04-ea1d-461e-a056-8f8c43108f65 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:38.984336 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51b26e04-ea1d-461e-a056-8f8c43108f65 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:39.023247 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9c632fe1-b3a3-4e7e-835c-81433c195cd8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093659 Jul 26 16:36:39.023247 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 258/501] 10.222.0.144 () {58 vars in 1280 bytes} [Tue Jul 26 16:36:38 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:36:39.117006 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-51b26e04-ea1d-461e-a056-8f8c43108f65 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:39.125923 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-51b26e04-ea1d-461e-a056-8f8c43108f65 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1712 microversion: 2.1 time: 0.153712 Jul 26 16:36:39.126551 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 244/502] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:38 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1712 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:36:40.147333 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-13365c07-6304-4925-9f17-de35cb09a757 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:40.147961 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-13365c07-6304-4925-9f17-de35cb09a757 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:40.154089 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-13365c07-6304-4925-9f17-de35cb09a757 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:40.155181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-13365c07-6304-4925-9f17-de35cb09a757 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:40.155955 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-13365c07-6304-4925-9f17-de35cb09a757 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:40.156420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-13365c07-6304-4925-9f17-de35cb09a757 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:40.360712 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-1cc8c139-a179-4ead-a177-c9a7428b705e req-d35d253f-b907-4676-91ed-7acda3445f4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178c5e10-8273-4f85-8802-ab643a1c9b6d", "tag": "1b0b636e-41d7-4e36-912a-bf842602d0ee"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:36:40.369994 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-13365c07-6304-4925-9f17-de35cb09a757 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:40.371629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-1cc8c139-a179-4ead-a177-c9a7428b705e req-d35d253f-b907-4676-91ed-7acda3445f4a service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:40.372155 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-1cc8c139-a179-4ead-a177-c9a7428b705e req-d35d253f-b907-4676-91ed-7acda3445f4a service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:40.379309 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-13365c07-6304-4925-9f17-de35cb09a757 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1712 microversion: 2.1 time: 0.236080 Jul 26 16:36:40.380175 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 259/503] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:40 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1712 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:36:40.386355 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-1cc8c139-a179-4ead-a177-c9a7428b705e req-d35d253f-b907-4676-91ed-7acda3445f4a service nova] Creating event network-changed:1b0b636e-41d7-4e36-912a-bf842602d0ee for instance 178c5e10-8273-4f85-8802-ab643a1c9b6d on hv-cinder-85104 Jul 26 16:36:40.391526 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-1cc8c139-a179-4ead-a177-c9a7428b705e req-d35d253f-b907-4676-91ed-7acda3445f4a service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035096 Jul 26 16:36:40.392379 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 245/504] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:36:41.401237 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5f5bf7cc-c07a-44b6-875c-19bd09771d13 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:36:41.402181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5f5bf7cc-c07a-44b6-875c-19bd09771d13 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:36:41.409160 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f5bf7cc-c07a-44b6-875c-19bd09771d13 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:41.409943 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f5bf7cc-c07a-44b6-875c-19bd09771d13 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:41.410733 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f5bf7cc-c07a-44b6-875c-19bd09771d13 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:36:41.411167 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f5bf7cc-c07a-44b6-875c-19bd09771d13 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:36:41.551265 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5f5bf7cc-c07a-44b6-875c-19bd09771d13 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:36:41.560861 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5f5bf7cc-c07a-44b6-875c-19bd09771d13 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1716 microversion: 2.1 time: 0.162062 Jul 26 16:36:41.561443 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 260/505] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:36:41 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:13.092463 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-723a05c8-df9a-431b-9ec2-f0ff288bedbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:13.093013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-723a05c8-df9a-431b-9ec2-f0ff288bedbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:13.095758 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=23 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:13.096614 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:13.101517 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-723a05c8-df9a-431b-9ec2-f0ff288bedbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:13.102020 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-723a05c8-df9a-431b-9ec2-f0ff288bedbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:13.102773 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-723a05c8-df9a-431b-9ec2-f0ff288bedbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:13.103206 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-723a05c8-df9a-431b-9ec2-f0ff288bedbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:13.125887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-723a05c8-df9a-431b-9ec2-f0ff288bedbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/ips" status: 200 len: 151 microversion: 2.20 time: 0.037716 Jul 26 16:37:13.126440 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 246/506] 10.222.0.144 () {60 vars in 1294 bytes} [Tue Jul 26 16:37:13 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:37:16.491749 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ca82781d-695c-426a-9f6f-7a0bd8989360 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:37:16.492354 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ca82781d-695c-426a-9f6f-7a0bd8989360 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:16.494467 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=19 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:16.495171 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=98 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:16.499831 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca82781d-695c-426a-9f6f-7a0bd8989360 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:16.501025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca82781d-695c-426a-9f6f-7a0bd8989360 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:16.501790 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca82781d-695c-426a-9f6f-7a0bd8989360 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:16.502218 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ca82781d-695c-426a-9f6f-7a0bd8989360 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:16.524377 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-ca82781d-695c-426a-9f6f-7a0bd8989360 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lazy-loading 'flavor' on Instance uuid d182cbe3-dff4-482c-a901-f084fc7b0077 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:37:17.546175 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ca82781d-695c-426a-9f6f-7a0bd8989360 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "POST /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/action" status: 202 len: 0 microversion: 2.20 time: 1.058263 Jul 26 16:37:17.547075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 261/507] 10.222.0.144 () {62 vars in 1324 bytes} [Tue Jul 26 16:37:16 2022] POST /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/action => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 26 16:37:17.555645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-47938be8-296f-430c-aceb-90e88fe46ba4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:17.556251 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-47938be8-296f-430c-aceb-90e88fe46ba4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:17.564572 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-47938be8-296f-430c-aceb-90e88fe46ba4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:17.565024 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-47938be8-296f-430c-aceb-90e88fe46ba4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:17.565784 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-47938be8-296f-430c-aceb-90e88fe46ba4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:17.566221 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-47938be8-296f-430c-aceb-90e88fe46ba4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:17.698813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-47938be8-296f-430c-aceb-90e88fe46ba4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:17.707232 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-47938be8-296f-430c-aceb-90e88fe46ba4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:17.712095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-47938be8-296f-430c-aceb-90e88fe46ba4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:17.712095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-47938be8-296f-430c-aceb-90e88fe46ba4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.158736 Jul 26 16:37:17.712095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 247/508] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:17 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:18.733139 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-327f6291-fd4d-44d4-bd0a-7a6f97cdb83d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:18.733830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-327f6291-fd4d-44d4-bd0a-7a6f97cdb83d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:18.740065 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-327f6291-fd4d-44d4-bd0a-7a6f97cdb83d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:18.740553 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-327f6291-fd4d-44d4-bd0a-7a6f97cdb83d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:18.741299 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-327f6291-fd4d-44d4-bd0a-7a6f97cdb83d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:18.741730 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-327f6291-fd4d-44d4-bd0a-7a6f97cdb83d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:18.876544 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-327f6291-fd4d-44d4-bd0a-7a6f97cdb83d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:18.884325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-327f6291-fd4d-44d4-bd0a-7a6f97cdb83d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:18.885845 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-327f6291-fd4d-44d4-bd0a-7a6f97cdb83d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:18.886984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-327f6291-fd4d-44d4-bd0a-7a6f97cdb83d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.158109 Jul 26 16:37:18.887530 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 262/509] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:18 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:19.910080 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-29de737d-d0f5-4d01-98c9-e29bb4be03a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:19.910697 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-29de737d-d0f5-4d01-98c9-e29bb4be03a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:19.917330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-29de737d-d0f5-4d01-98c9-e29bb4be03a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:19.917773 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-29de737d-d0f5-4d01-98c9-e29bb4be03a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:19.918523 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-29de737d-d0f5-4d01-98c9-e29bb4be03a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:19.918953 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-29de737d-d0f5-4d01-98c9-e29bb4be03a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:20.046617 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-29de737d-d0f5-4d01-98c9-e29bb4be03a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:20.055160 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-29de737d-d0f5-4d01-98c9-e29bb4be03a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:20.056896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-29de737d-d0f5-4d01-98c9-e29bb4be03a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:20.058073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-29de737d-d0f5-4d01-98c9-e29bb4be03a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.152366 Jul 26 16:37:20.058620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 248/510] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:19 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:21.082282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1d0c9333-4ecd-4d1e-a505-e557b906aab9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:21.082809 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1d0c9333-4ecd-4d1e-a505-e557b906aab9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:21.088867 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d0c9333-4ecd-4d1e-a505-e557b906aab9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:21.089312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d0c9333-4ecd-4d1e-a505-e557b906aab9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:21.090069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d0c9333-4ecd-4d1e-a505-e557b906aab9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:21.090500 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d0c9333-4ecd-4d1e-a505-e557b906aab9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:21.214605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1d0c9333-4ecd-4d1e-a505-e557b906aab9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:21.222447 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1d0c9333-4ecd-4d1e-a505-e557b906aab9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:21.223950 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1d0c9333-4ecd-4d1e-a505-e557b906aab9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:21.225146 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1d0c9333-4ecd-4d1e-a505-e557b906aab9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.147397 Jul 26 16:37:21.225695 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 263/511] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:21 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:22.248163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-584540ac-954e-4e0b-b949-e13a9f249192 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:22.248895 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-584540ac-954e-4e0b-b949-e13a9f249192 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:22.255055 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-584540ac-954e-4e0b-b949-e13a9f249192 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:22.255500 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-584540ac-954e-4e0b-b949-e13a9f249192 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:22.256265 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-584540ac-954e-4e0b-b949-e13a9f249192 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:22.256728 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-584540ac-954e-4e0b-b949-e13a9f249192 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:22.385811 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-584540ac-954e-4e0b-b949-e13a9f249192 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:22.394327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-584540ac-954e-4e0b-b949-e13a9f249192 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:22.395821 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-584540ac-954e-4e0b-b949-e13a9f249192 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:22.397245 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-584540ac-954e-4e0b-b949-e13a9f249192 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.152706 Jul 26 16:37:22.397962 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 249/512] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:22 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:23.421031 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-87a3a9c1-c8a0-4f27-be86-e7937291d1d6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:23.421762 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-87a3a9c1-c8a0-4f27-be86-e7937291d1d6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:23.428912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-87a3a9c1-c8a0-4f27-be86-e7937291d1d6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:23.429481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-87a3a9c1-c8a0-4f27-be86-e7937291d1d6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:23.430248 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-87a3a9c1-c8a0-4f27-be86-e7937291d1d6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:23.430675 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-87a3a9c1-c8a0-4f27-be86-e7937291d1d6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:23.559960 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-87a3a9c1-c8a0-4f27-be86-e7937291d1d6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:23.567855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-87a3a9c1-c8a0-4f27-be86-e7937291d1d6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:23.569540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-87a3a9c1-c8a0-4f27-be86-e7937291d1d6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:23.570676 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-87a3a9c1-c8a0-4f27-be86-e7937291d1d6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.153768 Jul 26 16:37:23.571216 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 264/513] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:23 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:37:24.593628 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2f2a4c84-2eea-4ec4-aa8b-0f58aa2b818c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:24.594239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2f2a4c84-2eea-4ec4-aa8b-0f58aa2b818c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:24.600814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2f2a4c84-2eea-4ec4-aa8b-0f58aa2b818c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:24.601271 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2f2a4c84-2eea-4ec4-aa8b-0f58aa2b818c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:24.602068 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2f2a4c84-2eea-4ec4-aa8b-0f58aa2b818c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:24.602506 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2f2a4c84-2eea-4ec4-aa8b-0f58aa2b818c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:24.731998 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2f2a4c84-2eea-4ec4-aa8b-0f58aa2b818c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:24.740487 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2f2a4c84-2eea-4ec4-aa8b-0f58aa2b818c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:24.742013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2f2a4c84-2eea-4ec4-aa8b-0f58aa2b818c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:24.743166 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2f2a4c84-2eea-4ec4-aa8b-0f58aa2b818c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.153434 Jul 26 16:37:24.743771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 250/514] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:24 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:25.765479 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ecdf3fff-c39a-4c47-82ec-7902dcd2ebd5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:25.765992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ecdf3fff-c39a-4c47-82ec-7902dcd2ebd5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:25.772895 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ecdf3fff-c39a-4c47-82ec-7902dcd2ebd5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:25.773344 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ecdf3fff-c39a-4c47-82ec-7902dcd2ebd5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:25.774103 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ecdf3fff-c39a-4c47-82ec-7902dcd2ebd5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:25.774535 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ecdf3fff-c39a-4c47-82ec-7902dcd2ebd5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:25.900314 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ecdf3fff-c39a-4c47-82ec-7902dcd2ebd5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:25.908120 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ecdf3fff-c39a-4c47-82ec-7902dcd2ebd5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:25.909660 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ecdf3fff-c39a-4c47-82ec-7902dcd2ebd5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:25.910890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ecdf3fff-c39a-4c47-82ec-7902dcd2ebd5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.149458 Jul 26 16:37:25.911447 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 265/515] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:25 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:26.934157 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-dece4e54-c2c9-48bd-87a8-7193439dcb32 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:26.934760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-dece4e54-c2c9-48bd-87a8-7193439dcb32 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:26.941226 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dece4e54-c2c9-48bd-87a8-7193439dcb32 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:26.941672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dece4e54-c2c9-48bd-87a8-7193439dcb32 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:26.942423 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dece4e54-c2c9-48bd-87a8-7193439dcb32 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:26.942852 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dece4e54-c2c9-48bd-87a8-7193439dcb32 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:27.071681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-dece4e54-c2c9-48bd-87a8-7193439dcb32 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:27.076477 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-dece4e54-c2c9-48bd-87a8-7193439dcb32 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:27.077992 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-dece4e54-c2c9-48bd-87a8-7193439dcb32 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:27.079712 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-dece4e54-c2c9-48bd-87a8-7193439dcb32 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.148908 Jul 26 16:37:27.080275 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 251/516] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:26 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:28.102438 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c9c60e7b-a546-46d0-97ce-55f7443a5770 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:28.103036 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c9c60e7b-a546-46d0-97ce-55f7443a5770 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:28.109142 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9c60e7b-a546-46d0-97ce-55f7443a5770 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:28.109586 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9c60e7b-a546-46d0-97ce-55f7443a5770 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:28.110338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9c60e7b-a546-46d0-97ce-55f7443a5770 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:28.110764 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9c60e7b-a546-46d0-97ce-55f7443a5770 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:28.239489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c9c60e7b-a546-46d0-97ce-55f7443a5770 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:28.247234 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c9c60e7b-a546-46d0-97ce-55f7443a5770 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:28.248756 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c9c60e7b-a546-46d0-97ce-55f7443a5770 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:28.249887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c9c60e7b-a546-46d0-97ce-55f7443a5770 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.151342 Jul 26 16:37:28.250430 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 266/517] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:28 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:29.272393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ca752d2b-b706-43e3-a335-e04651872c25 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:29.273009 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ca752d2b-b706-43e3-a335-e04651872c25 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:29.279621 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ca752d2b-b706-43e3-a335-e04651872c25 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:29.280097 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ca752d2b-b706-43e3-a335-e04651872c25 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:29.280945 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ca752d2b-b706-43e3-a335-e04651872c25 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:29.281380 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ca752d2b-b706-43e3-a335-e04651872c25 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:29.413219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ca752d2b-b706-43e3-a335-e04651872c25 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:29.421417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ca752d2b-b706-43e3-a335-e04651872c25 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:29.423519 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ca752d2b-b706-43e3-a335-e04651872c25 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:29.424750 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ca752d2b-b706-43e3-a335-e04651872c25 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.156521 Jul 26 16:37:29.425308 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 252/518] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:29 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:37:29.516988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-07ee7546-3a7d-4915-8113-c7ba3edffea6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd88420c-63e1-453c-bcf7-1f05274aeb14"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:37:29.519284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-07ee7546-3a7d-4915-8113-c7ba3edffea6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:29.525593 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-07ee7546-3a7d-4915-8113-c7ba3edffea6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:29.525979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-07ee7546-3a7d-4915-8113-c7ba3edffea6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:29.526730 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-07ee7546-3a7d-4915-8113-c7ba3edffea6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:29.527158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-07ee7546-3a7d-4915-8113-c7ba3edffea6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:30.447440 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b4a673eb-7ee0-44ad-9133-3f8a4d80d9ee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:30.448046 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b4a673eb-7ee0-44ad-9133-3f8a4d80d9ee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:30.456446 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b4a673eb-7ee0-44ad-9133-3f8a4d80d9ee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:30.456934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b4a673eb-7ee0-44ad-9133-3f8a4d80d9ee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:30.458179 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b4a673eb-7ee0-44ad-9133-3f8a4d80d9ee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:30.458777 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b4a673eb-7ee0-44ad-9133-3f8a4d80d9ee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:30.514127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-07ee7546-3a7d-4915-8113-c7ba3edffea6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.994088 Jul 26 16:37:30.514127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 267/519] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:37:29 2022] POST /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments => generated 194 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:37:30.599579 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b4a673eb-7ee0-44ad-9133-3f8a4d80d9ee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:30.607702 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b4a673eb-7ee0-44ad-9133-3f8a4d80d9ee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:30.609359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b4a673eb-7ee0-44ad-9133-3f8a4d80d9ee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:30.611018 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b4a673eb-7ee0-44ad-9133-3f8a4d80d9ee tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1747 microversion: 2.20 time: 0.166981 Jul 26 16:37:30.611565 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 253/520] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:30 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1747 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:37:31.635716 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a4d03b5a-5221-447c-8934-1e2531f9cfd6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:31.636924 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a4d03b5a-5221-447c-8934-1e2531f9cfd6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:31.647388 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a4d03b5a-5221-447c-8934-1e2531f9cfd6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:31.647832 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a4d03b5a-5221-447c-8934-1e2531f9cfd6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:31.648622 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a4d03b5a-5221-447c-8934-1e2531f9cfd6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:31.649055 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a4d03b5a-5221-447c-8934-1e2531f9cfd6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:31.778224 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a4d03b5a-5221-447c-8934-1e2531f9cfd6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:31.790209 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a4d03b5a-5221-447c-8934-1e2531f9cfd6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:31.791741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a4d03b5a-5221-447c-8934-1e2531f9cfd6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:31.792947 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a4d03b5a-5221-447c-8934-1e2531f9cfd6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1747 microversion: 2.20 time: 0.161630 Jul 26 16:37:31.793494 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 268/521] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:31 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1747 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:32.817497 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6f9f1a6c-4cfb-4468-9b79-bb12a61d7009 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:32.822956 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6f9f1a6c-4cfb-4468-9b79-bb12a61d7009 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:32.825736 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6f9f1a6c-4cfb-4468-9b79-bb12a61d7009 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:32.826218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6f9f1a6c-4cfb-4468-9b79-bb12a61d7009 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:32.826991 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6f9f1a6c-4cfb-4468-9b79-bb12a61d7009 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:32.827424 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6f9f1a6c-4cfb-4468-9b79-bb12a61d7009 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:33.070954 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6f9f1a6c-4cfb-4468-9b79-bb12a61d7009 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:33.078731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6f9f1a6c-4cfb-4468-9b79-bb12a61d7009 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:33.080871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6f9f1a6c-4cfb-4468-9b79-bb12a61d7009 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:33.082026 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6f9f1a6c-4cfb-4468-9b79-bb12a61d7009 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1747 microversion: 2.20 time: 0.269440 Jul 26 16:37:33.082595 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 254/522] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:32 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1747 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:34.104786 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3c083db5-7709-443f-8443-3c451609457f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:34.105326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3c083db5-7709-443f-8443-3c451609457f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:34.112379 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3c083db5-7709-443f-8443-3c451609457f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:34.112864 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3c083db5-7709-443f-8443-3c451609457f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:34.113632 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3c083db5-7709-443f-8443-3c451609457f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:34.114073 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3c083db5-7709-443f-8443-3c451609457f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:34.295803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3c083db5-7709-443f-8443-3c451609457f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:34.304324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3c083db5-7709-443f-8443-3c451609457f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:34.305871 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3c083db5-7709-443f-8443-3c451609457f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:34.307026 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3c083db5-7709-443f-8443-3c451609457f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1747 microversion: 2.20 time: 0.206264 Jul 26 16:37:34.307587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 269/523] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:34 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1747 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:34.610549 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-afe3bebc-8609-4e4c-953a-a1f5dcd8dff5 req-c131ca80-639c-4a73-90b4-85b8c8d54063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d182cbe3-dff4-482c-a901-f084fc7b0077", "name": "network-vif-plugged", "status": "completed", "tag": "7f871a00-9630-48c9-845a-ddb06fb9a2df"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:37:34.620867 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-afe3bebc-8609-4e4c-953a-a1f5dcd8dff5 req-c131ca80-639c-4a73-90b4-85b8c8d54063 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:34.621341 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-afe3bebc-8609-4e4c-953a-a1f5dcd8dff5 req-c131ca80-639c-4a73-90b4-85b8c8d54063 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:34.633430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-afe3bebc-8609-4e4c-953a-a1f5dcd8dff5 req-c131ca80-639c-4a73-90b4-85b8c8d54063 service nova] Creating event network-vif-plugged:7f871a00-9630-48c9-845a-ddb06fb9a2df for instance d182cbe3-dff4-482c-a901-f084fc7b0077 on hv-cinder-85104 Jul 26 16:37:34.638475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-afe3bebc-8609-4e4c-953a-a1f5dcd8dff5 req-c131ca80-639c-4a73-90b4-85b8c8d54063 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031653 Jul 26 16:37:34.639068 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 255/524] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:37:35.330239 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-34afd1df-f529-4f58-8a1c-ce19c5feb1b2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:35.330964 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-34afd1df-f529-4f58-8a1c-ce19c5feb1b2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:35.337579 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34afd1df-f529-4f58-8a1c-ce19c5feb1b2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:35.338029 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34afd1df-f529-4f58-8a1c-ce19c5feb1b2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:35.338797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34afd1df-f529-4f58-8a1c-ce19c5feb1b2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:35.339233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34afd1df-f529-4f58-8a1c-ce19c5feb1b2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:35.470580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-34afd1df-f529-4f58-8a1c-ce19c5feb1b2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:35.478691 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-34afd1df-f529-4f58-8a1c-ce19c5feb1b2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:35.480236 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-34afd1df-f529-4f58-8a1c-ce19c5feb1b2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:35.481816 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-34afd1df-f529-4f58-8a1c-ce19c5feb1b2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1747 microversion: 2.20 time: 0.155753 Jul 26 16:37:35.482380 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 270/525] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:35 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:36.505390 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-38f1b0f3-e28c-4e78-86c7-54a446008850 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:36.506087 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-38f1b0f3-e28c-4e78-86c7-54a446008850 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:36.512266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-38f1b0f3-e28c-4e78-86c7-54a446008850 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:36.512744 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-38f1b0f3-e28c-4e78-86c7-54a446008850 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:36.513505 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-38f1b0f3-e28c-4e78-86c7-54a446008850 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:36.513942 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-38f1b0f3-e28c-4e78-86c7-54a446008850 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:36.653347 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-38f1b0f3-e28c-4e78-86c7-54a446008850 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:36.661829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-38f1b0f3-e28c-4e78-86c7-54a446008850 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:36.663331 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-38f1b0f3-e28c-4e78-86c7-54a446008850 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:36.664504 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-38f1b0f3-e28c-4e78-86c7-54a446008850 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1747 microversion: 2.20 time: 0.163854 Jul 26 16:37:36.665068 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 256/526] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:36 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1747 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:37:37.687008 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-40642d5f-300d-4c94-9b82-9496aaf7afa2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:37.687601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-40642d5f-300d-4c94-9b82-9496aaf7afa2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:37.703946 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-40642d5f-300d-4c94-9b82-9496aaf7afa2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:37.704436 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-40642d5f-300d-4c94-9b82-9496aaf7afa2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:37.705252 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-40642d5f-300d-4c94-9b82-9496aaf7afa2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:37.705683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-40642d5f-300d-4c94-9b82-9496aaf7afa2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:37.865825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-40642d5f-300d-4c94-9b82-9496aaf7afa2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:37.874069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-40642d5f-300d-4c94-9b82-9496aaf7afa2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:37.875582 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-40642d5f-300d-4c94-9b82-9496aaf7afa2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:37.876764 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-40642d5f-300d-4c94-9b82-9496aaf7afa2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1747 microversion: 2.20 time: 0.193721 Jul 26 16:37:37.877521 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 271/527] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:37 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1747 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:38.900273 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8a912c0e-1d43-4706-8758-f97d19f41a22 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:38.901706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8a912c0e-1d43-4706-8758-f97d19f41a22 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:38.908811 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a912c0e-1d43-4706-8758-f97d19f41a22 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:38.909854 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a912c0e-1d43-4706-8758-f97d19f41a22 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:38.911000 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a912c0e-1d43-4706-8758-f97d19f41a22 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:38.911662 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a912c0e-1d43-4706-8758-f97d19f41a22 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:39.123630 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8a912c0e-1d43-4706-8758-f97d19f41a22 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:39.133437 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8a912c0e-1d43-4706-8758-f97d19f41a22 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:39.135399 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8a912c0e-1d43-4706-8758-f97d19f41a22 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:39.136595 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8a912c0e-1d43-4706-8758-f97d19f41a22 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.241385 Jul 26 16:37:39.137716 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 257/528] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:38 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:40.160324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fcc2d428-e847-4408-ac21-05d5258d050c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:40.161074 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fcc2d428-e847-4408-ac21-05d5258d050c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:40.167628 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fcc2d428-e847-4408-ac21-05d5258d050c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:40.168068 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fcc2d428-e847-4408-ac21-05d5258d050c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:40.168880 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fcc2d428-e847-4408-ac21-05d5258d050c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:40.169326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fcc2d428-e847-4408-ac21-05d5258d050c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:40.180053 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-65f4dd66-5f70-424d-a64a-b822d2b51ceb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:37:40.182973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-65f4dd66-5f70-424d-a64a-b822d2b51ceb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:40.189687 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-65f4dd66-5f70-424d-a64a-b822d2b51ceb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:40.190141 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-65f4dd66-5f70-424d-a64a-b822d2b51ceb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:40.191395 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-65f4dd66-5f70-424d-a64a-b822d2b51ceb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:40.191836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-65f4dd66-5f70-424d-a64a-b822d2b51ceb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:40.217365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-65f4dd66-5f70-424d-a64a-b822d2b51ceb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lazy-loading 'flavor' on Instance uuid 7b3a6262-8adc-4597-8d00-35af06cee7de {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:37:40.381923 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fcc2d428-e847-4408-ac21-05d5258d050c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:40.394553 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fcc2d428-e847-4408-ac21-05d5258d050c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:40.397182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fcc2d428-e847-4408-ac21-05d5258d050c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:40.399948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fcc2d428-e847-4408-ac21-05d5258d050c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.243268 Jul 26 16:37:40.401771 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 272/529] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:40 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:40.712526 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-65f4dd66-5f70-424d-a64a-b822d2b51ceb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/action" status: 200 len: 32 microversion: 2.1 time: 0.536319 Jul 26 16:37:40.713617 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 258/530] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:37:40 2022] POST /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/action => generated 32 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 16:37:40.723780 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-645df8d8-20f6-47cb-8131-fb6d04528641 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:40.724652 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-645df8d8-20f6-47cb-8131-fb6d04528641 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:40.731777 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-645df8d8-20f6-47cb-8131-fb6d04528641 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:40.732654 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-645df8d8-20f6-47cb-8131-fb6d04528641 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:40.733657 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-645df8d8-20f6-47cb-8131-fb6d04528641 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:40.734326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-645df8d8-20f6-47cb-8131-fb6d04528641 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:40.931582 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-645df8d8-20f6-47cb-8131-fb6d04528641 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:40.940903 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-645df8d8-20f6-47cb-8131-fb6d04528641 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.221200 Jul 26 16:37:40.942441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 273/531] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:40 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:41.425900 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-25b97b75-dff9-461a-b6f0-950d8d756fe7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:41.426604 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-25b97b75-dff9-461a-b6f0-950d8d756fe7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:41.433011 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-25b97b75-dff9-461a-b6f0-950d8d756fe7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:41.433469 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-25b97b75-dff9-461a-b6f0-950d8d756fe7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:41.434249 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-25b97b75-dff9-461a-b6f0-950d8d756fe7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:41.434688 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-25b97b75-dff9-461a-b6f0-950d8d756fe7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:41.586887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-25b97b75-dff9-461a-b6f0-950d8d756fe7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:41.596878 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-25b97b75-dff9-461a-b6f0-950d8d756fe7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:41.598614 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-25b97b75-dff9-461a-b6f0-950d8d756fe7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:41.599970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-25b97b75-dff9-461a-b6f0-950d8d756fe7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.178849 Jul 26 16:37:41.600830 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 259/532] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:41 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:41.965235 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0eb9361c-91a6-478f-b2b1-4285971feddf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:41.966593 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0eb9361c-91a6-478f-b2b1-4285971feddf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:41.973806 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0eb9361c-91a6-478f-b2b1-4285971feddf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:41.974259 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0eb9361c-91a6-478f-b2b1-4285971feddf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:41.975065 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0eb9361c-91a6-478f-b2b1-4285971feddf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:41.975496 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0eb9361c-91a6-478f-b2b1-4285971feddf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:41.979552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:42.115499 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0eb9361c-91a6-478f-b2b1-4285971feddf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:42.124090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0eb9361c-91a6-478f-b2b1-4285971feddf tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.163106 Jul 26 16:37:42.129067 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 274/533] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:41 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:42.626120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7d4862b6-2050-4332-a13d-7458394de88f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:42.627300 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7d4862b6-2050-4332-a13d-7458394de88f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:42.637982 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d4862b6-2050-4332-a13d-7458394de88f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:42.638469 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d4862b6-2050-4332-a13d-7458394de88f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:42.639758 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d4862b6-2050-4332-a13d-7458394de88f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:42.640206 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d4862b6-2050-4332-a13d-7458394de88f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:42.787229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7d4862b6-2050-4332-a13d-7458394de88f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:42.795177 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7d4862b6-2050-4332-a13d-7458394de88f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:42.796799 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7d4862b6-2050-4332-a13d-7458394de88f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:42.798011 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7d4862b6-2050-4332-a13d-7458394de88f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.176115 Jul 26 16:37:42.798564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 260/534] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:42 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:43.145604 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8ee78a5c-e868-4398-89e3-baa4ae9c1dbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:43.146381 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8ee78a5c-e868-4398-89e3-baa4ae9c1dbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:43.153475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ee78a5c-e868-4398-89e3-baa4ae9c1dbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:43.153920 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ee78a5c-e868-4398-89e3-baa4ae9c1dbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:43.154670 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ee78a5c-e868-4398-89e3-baa4ae9c1dbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:43.155146 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8ee78a5c-e868-4398-89e3-baa4ae9c1dbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:43.302705 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8ee78a5c-e868-4398-89e3-baa4ae9c1dbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:43.311625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8ee78a5c-e868-4398-89e3-baa4ae9c1dbb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.169959 Jul 26 16:37:43.314046 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 275/535] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:43 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:43.820877 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1481f43e-035a-4e95-aea3-5dd37fda5dbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:43.821833 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1481f43e-035a-4e95-aea3-5dd37fda5dbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:43.828433 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1481f43e-035a-4e95-aea3-5dd37fda5dbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:43.830191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1481f43e-035a-4e95-aea3-5dd37fda5dbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:43.830191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1481f43e-035a-4e95-aea3-5dd37fda5dbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:43.830700 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1481f43e-035a-4e95-aea3-5dd37fda5dbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:43.851149 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:43.990863 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1481f43e-035a-4e95-aea3-5dd37fda5dbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:43.998850 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1481f43e-035a-4e95-aea3-5dd37fda5dbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:44.000418 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1481f43e-035a-4e95-aea3-5dd37fda5dbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:44.001614 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1481f43e-035a-4e95-aea3-5dd37fda5dbe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.184668 Jul 26 16:37:44.002476 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 261/536] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:43 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:44.335087 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7cfab5fd-37e4-4664-b7de-029037182ebc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:44.336320 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7cfab5fd-37e4-4664-b7de-029037182ebc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:44.343732 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cfab5fd-37e4-4664-b7de-029037182ebc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:44.344180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cfab5fd-37e4-4664-b7de-029037182ebc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:44.345441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cfab5fd-37e4-4664-b7de-029037182ebc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:44.345884 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cfab5fd-37e4-4664-b7de-029037182ebc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:44.498500 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7cfab5fd-37e4-4664-b7de-029037182ebc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:44.507849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7cfab5fd-37e4-4664-b7de-029037182ebc tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.176793 Jul 26 16:37:44.520840 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 276/537] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:44 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:45.027548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9df70860-293d-49dc-8c34-2facb9607fdc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:45.028167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9df70860-293d-49dc-8c34-2facb9607fdc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:45.035583 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9df70860-293d-49dc-8c34-2facb9607fdc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:45.036126 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9df70860-293d-49dc-8c34-2facb9607fdc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:45.036934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9df70860-293d-49dc-8c34-2facb9607fdc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:45.037378 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9df70860-293d-49dc-8c34-2facb9607fdc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:45.188148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9df70860-293d-49dc-8c34-2facb9607fdc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:45.200851 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9df70860-293d-49dc-8c34-2facb9607fdc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:45.202708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9df70860-293d-49dc-8c34-2facb9607fdc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:45.204170 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9df70860-293d-49dc-8c34-2facb9607fdc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.180475 Jul 26 16:37:45.204989 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 262/538] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:45 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:45.667120 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-acd98d8b-d126-42f2-b571-b49678c7d6ae tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:45.667759 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-acd98d8b-d126-42f2-b571-b49678c7d6ae tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:45.673895 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-acd98d8b-d126-42f2-b571-b49678c7d6ae tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:45.674412 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-acd98d8b-d126-42f2-b571-b49678c7d6ae tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:45.675083 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-acd98d8b-d126-42f2-b571-b49678c7d6ae tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:45.675626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-acd98d8b-d126-42f2-b571-b49678c7d6ae tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:45.824797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-acd98d8b-d126-42f2-b571-b49678c7d6ae tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:45.841680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-acd98d8b-d126-42f2-b571-b49678c7d6ae tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.313704 Jul 26 16:37:45.842284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 277/539] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:45 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:37:46.230197 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f08e6973-45bf-43be-b00b-514303ab9eae tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:46.230853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f08e6973-45bf-43be-b00b-514303ab9eae tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:46.237363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f08e6973-45bf-43be-b00b-514303ab9eae tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:46.237817 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f08e6973-45bf-43be-b00b-514303ab9eae tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:46.238589 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f08e6973-45bf-43be-b00b-514303ab9eae tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:46.239026 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f08e6973-45bf-43be-b00b-514303ab9eae tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:46.372075 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f08e6973-45bf-43be-b00b-514303ab9eae tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:46.380019 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f08e6973-45bf-43be-b00b-514303ab9eae tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:46.381576 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f08e6973-45bf-43be-b00b-514303ab9eae tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:46.382730 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f08e6973-45bf-43be-b00b-514303ab9eae tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.156749 Jul 26 16:37:46.383286 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 263/540] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:46 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:46.866087 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dbaf09da-f883-49e5-8e0e-66557d6d2290 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:46.866680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dbaf09da-f883-49e5-8e0e-66557d6d2290 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:46.869053 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=35 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:46.877504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dbaf09da-f883-49e5-8e0e-66557d6d2290 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:46.878281 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dbaf09da-f883-49e5-8e0e-66557d6d2290 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:46.879304 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dbaf09da-f883-49e5-8e0e-66557d6d2290 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:46.879810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dbaf09da-f883-49e5-8e0e-66557d6d2290 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:47.018665 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-dbaf09da-f883-49e5-8e0e-66557d6d2290 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:47.030305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dbaf09da-f883-49e5-8e0e-66557d6d2290 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.167597 Jul 26 16:37:47.031295 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 278/541] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:46 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:37:47.407268 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f0f3106d-438e-421f-b2f7-9f04b5381227 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:47.408581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f0f3106d-438e-421f-b2f7-9f04b5381227 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:47.416575 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f0f3106d-438e-421f-b2f7-9f04b5381227 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:47.417402 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f0f3106d-438e-421f-b2f7-9f04b5381227 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:47.418409 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f0f3106d-438e-421f-b2f7-9f04b5381227 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:47.419116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f0f3106d-438e-421f-b2f7-9f04b5381227 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:47.586877 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f0f3106d-438e-421f-b2f7-9f04b5381227 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:47.596425 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f0f3106d-438e-421f-b2f7-9f04b5381227 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:47.597357 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f0f3106d-438e-421f-b2f7-9f04b5381227 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:47.598535 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f0f3106d-438e-421f-b2f7-9f04b5381227 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.195273 Jul 26 16:37:47.599390 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 264/542] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:47 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:47.883405 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:37:47.885668 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:37:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:37:48.052216 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f6f30d7d-a1fb-4fc1-87bd-c68a62563c26 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:48.052857 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f6f30d7d-a1fb-4fc1-87bd-c68a62563c26 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:48.059739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f6f30d7d-a1fb-4fc1-87bd-c68a62563c26 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:48.060270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f6f30d7d-a1fb-4fc1-87bd-c68a62563c26 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:48.061147 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f6f30d7d-a1fb-4fc1-87bd-c68a62563c26 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:48.061591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f6f30d7d-a1fb-4fc1-87bd-c68a62563c26 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:48.208694 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f6f30d7d-a1fb-4fc1-87bd-c68a62563c26 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:48.218948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f6f30d7d-a1fb-4fc1-87bd-c68a62563c26 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.170674 Jul 26 16:37:48.219913 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 279/543] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:48 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:48.621326 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cd60961d-759e-4f8d-bd13-3f0f079a3bd4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:48.622065 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cd60961d-759e-4f8d-bd13-3f0f079a3bd4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:48.624415 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=39 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:48.630486 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd60961d-759e-4f8d-bd13-3f0f079a3bd4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:48.631244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd60961d-759e-4f8d-bd13-3f0f079a3bd4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:48.632049 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd60961d-759e-4f8d-bd13-3f0f079a3bd4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:48.633782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd60961d-759e-4f8d-bd13-3f0f079a3bd4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:48.650579 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:37:48.650791 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Tue Jul 26 16:37:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:37:48.797666 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cd60961d-759e-4f8d-bd13-3f0f079a3bd4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:48.808731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cd60961d-759e-4f8d-bd13-3f0f079a3bd4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:48.810248 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cd60961d-759e-4f8d-bd13-3f0f079a3bd4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:48.811411 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cd60961d-759e-4f8d-bd13-3f0f079a3bd4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.194079 Jul 26 16:37:48.812249 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 265/544] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:48 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:49.247393 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-98f4a7a6-1248-44f5-a306-265abd63fc1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:49.248716 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-98f4a7a6-1248-44f5-a306-265abd63fc1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:49.257022 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-98f4a7a6-1248-44f5-a306-265abd63fc1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:49.258432 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-98f4a7a6-1248-44f5-a306-265abd63fc1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:49.259237 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-98f4a7a6-1248-44f5-a306-265abd63fc1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:49.259680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-98f4a7a6-1248-44f5-a306-265abd63fc1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:49.399197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-98f4a7a6-1248-44f5-a306-265abd63fc1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:49.410005 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-98f4a7a6-1248-44f5-a306-265abd63fc1e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.171788 Jul 26 16:37:49.410595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 280/545] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:49 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:49.834687 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2715e4a6-9849-4078-8f9a-7e5fb7008060 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:49.835298 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2715e4a6-9849-4078-8f9a-7e5fb7008060 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:49.841783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2715e4a6-9849-4078-8f9a-7e5fb7008060 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:49.842237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2715e4a6-9849-4078-8f9a-7e5fb7008060 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:49.843002 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2715e4a6-9849-4078-8f9a-7e5fb7008060 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:49.843458 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2715e4a6-9849-4078-8f9a-7e5fb7008060 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:49.979777 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2715e4a6-9849-4078-8f9a-7e5fb7008060 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:49.987762 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2715e4a6-9849-4078-8f9a-7e5fb7008060 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:49.989329 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2715e4a6-9849-4078-8f9a-7e5fb7008060 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:49.990480 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2715e4a6-9849-4078-8f9a-7e5fb7008060 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.159716 Jul 26 16:37:49.991031 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 266/546] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:49 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:50.432275 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b42e91bb-98a8-491a-bfa2-c7e82877d9ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:50.433601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b42e91bb-98a8-491a-bfa2-c7e82877d9ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:50.440614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b42e91bb-98a8-491a-bfa2-c7e82877d9ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:50.441058 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b42e91bb-98a8-491a-bfa2-c7e82877d9ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:50.442016 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b42e91bb-98a8-491a-bfa2-c7e82877d9ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:50.442455 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b42e91bb-98a8-491a-bfa2-c7e82877d9ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:50.586086 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b42e91bb-98a8-491a-bfa2-c7e82877d9ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:50.595350 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b42e91bb-98a8-491a-bfa2-c7e82877d9ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.167035 Jul 26 16:37:50.596295 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 281/547] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:50 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:51.012739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e95a60c7-871f-408e-a8b0-34adf6ce032e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:51.013381 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e95a60c7-871f-408e-a8b0-34adf6ce032e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:51.020245 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e95a60c7-871f-408e-a8b0-34adf6ce032e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:51.020721 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e95a60c7-871f-408e-a8b0-34adf6ce032e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:51.021480 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e95a60c7-871f-408e-a8b0-34adf6ce032e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:51.021910 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e95a60c7-871f-408e-a8b0-34adf6ce032e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:51.148199 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e95a60c7-871f-408e-a8b0-34adf6ce032e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:51.156087 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e95a60c7-871f-408e-a8b0-34adf6ce032e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:51.160240 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e95a60c7-871f-408e-a8b0-34adf6ce032e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:51.160240 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e95a60c7-871f-408e-a8b0-34adf6ce032e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.150031 Jul 26 16:37:51.160240 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 267/548] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:51 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:51.616426 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a14ca4d8-07ed-4656-affb-2addd7323e75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:51.617069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a14ca4d8-07ed-4656-affb-2addd7323e75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:51.623469 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a14ca4d8-07ed-4656-affb-2addd7323e75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:51.623909 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a14ca4d8-07ed-4656-affb-2addd7323e75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:51.624699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a14ca4d8-07ed-4656-affb-2addd7323e75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:51.625118 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a14ca4d8-07ed-4656-affb-2addd7323e75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:51.756512 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a14ca4d8-07ed-4656-affb-2addd7323e75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:51.764320 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a14ca4d8-07ed-4656-affb-2addd7323e75 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.151740 Jul 26 16:37:51.764903 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 282/549] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:51 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:52.182537 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7868096b-3b88-47a3-8f96-f99d7e05197b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:52.183147 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7868096b-3b88-47a3-8f96-f99d7e05197b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:52.189761 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7868096b-3b88-47a3-8f96-f99d7e05197b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:52.190194 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7868096b-3b88-47a3-8f96-f99d7e05197b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:52.190950 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7868096b-3b88-47a3-8f96-f99d7e05197b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:52.191383 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7868096b-3b88-47a3-8f96-f99d7e05197b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:52.321955 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7868096b-3b88-47a3-8f96-f99d7e05197b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:52.331208 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7868096b-3b88-47a3-8f96-f99d7e05197b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:52.332738 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7868096b-3b88-47a3-8f96-f99d7e05197b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:52.333896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7868096b-3b88-47a3-8f96-f99d7e05197b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1742 microversion: 2.20 time: 0.155195 Jul 26 16:37:52.334454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 268/550] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:52 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:52.786714 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-29c0195b-e939-44ce-84e4-6b50f5a152f8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:52.787324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-29c0195b-e939-44ce-84e4-6b50f5a152f8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:52.793649 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-29c0195b-e939-44ce-84e4-6b50f5a152f8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:52.800692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-29c0195b-e939-44ce-84e4-6b50f5a152f8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:52.800692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-29c0195b-e939-44ce-84e4-6b50f5a152f8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:52.800692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-29c0195b-e939-44ce-84e4-6b50f5a152f8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:52.926690 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-29c0195b-e939-44ce-84e4-6b50f5a152f8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:52.934608 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-29c0195b-e939-44ce-84e4-6b50f5a152f8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.152270 Jul 26 16:37:52.935163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 283/551] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:52 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:53.366228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f23f85dd-99eb-4728-a111-5a0088c6cb3f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:53.366832 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f23f85dd-99eb-4728-a111-5a0088c6cb3f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:53.373240 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f23f85dd-99eb-4728-a111-5a0088c6cb3f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:53.373688 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f23f85dd-99eb-4728-a111-5a0088c6cb3f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:53.374449 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f23f85dd-99eb-4728-a111-5a0088c6cb3f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:53.374880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f23f85dd-99eb-4728-a111-5a0088c6cb3f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:53.508050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f23f85dd-99eb-4728-a111-5a0088c6cb3f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:53.515934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f23f85dd-99eb-4728-a111-5a0088c6cb3f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:53.518100 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f23f85dd-99eb-4728-a111-5a0088c6cb3f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:53.519233 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f23f85dd-99eb-4728-a111-5a0088c6cb3f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1724 microversion: 2.20 time: 0.156912 Jul 26 16:37:53.519788 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 269/552] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:53 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:53.955160 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2d742054-dbb0-47fb-8767-169db7a8b958 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:53.955763 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2d742054-dbb0-47fb-8767-169db7a8b958 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:53.962277 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d742054-dbb0-47fb-8767-169db7a8b958 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:53.962718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d742054-dbb0-47fb-8767-169db7a8b958 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:53.963558 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d742054-dbb0-47fb-8767-169db7a8b958 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:53.963991 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d742054-dbb0-47fb-8767-169db7a8b958 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:54.098651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2d742054-dbb0-47fb-8767-169db7a8b958 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:54.103455 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2d742054-dbb0-47fb-8767-169db7a8b958 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.152174 Jul 26 16:37:54.104059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 284/553] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:53 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:54.542283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a6d427fa-c4fc-42ed-a508-104ed9bd1198 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:54.542899 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a6d427fa-c4fc-42ed-a508-104ed9bd1198 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:54.550053 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a6d427fa-c4fc-42ed-a508-104ed9bd1198 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:54.550508 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a6d427fa-c4fc-42ed-a508-104ed9bd1198 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:54.551279 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a6d427fa-c4fc-42ed-a508-104ed9bd1198 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:54.551711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a6d427fa-c4fc-42ed-a508-104ed9bd1198 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:54.668961 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-850ed1bc-0431-41c3-8da6-e2a1fb248d2f req-4648addf-cb32-4198-8ce3-195189de3cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d182cbe3-dff4-482c-a901-f084fc7b0077", "name": "network-vif-unplugged", "status": "completed", "tag": "7f871a00-9630-48c9-845a-ddb06fb9a2df"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:37:54.679373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-850ed1bc-0431-41c3-8da6-e2a1fb248d2f req-4648addf-cb32-4198-8ce3-195189de3cb9 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:54.686603 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-850ed1bc-0431-41c3-8da6-e2a1fb248d2f req-4648addf-cb32-4198-8ce3-195189de3cb9 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:54.686853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a6d427fa-c4fc-42ed-a508-104ed9bd1198 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:54.691255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a6d427fa-c4fc-42ed-a508-104ed9bd1198 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:54.693044 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a6d427fa-c4fc-42ed-a508-104ed9bd1198 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:54.693397 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-850ed1bc-0431-41c3-8da6-e2a1fb248d2f req-4648addf-cb32-4198-8ce3-195189de3cb9 service nova] Creating event network-vif-unplugged:7f871a00-9630-48c9-845a-ddb06fb9a2df for instance d182cbe3-dff4-482c-a901-f084fc7b0077 on hv-cinder-85104 Jul 26 16:37:54.694189 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a6d427fa-c4fc-42ed-a508-104ed9bd1198 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1724 microversion: 2.20 time: 0.155842 Jul 26 16:37:54.694960 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 270/554] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:54 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:54.698948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-850ed1bc-0431-41c3-8da6-e2a1fb248d2f req-4648addf-cb32-4198-8ce3-195189de3cb9 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033665 Jul 26 16:37:54.699468 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 285/555] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:37:55.126384 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a333f819-7e0b-44db-996a-155e376e60e5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:55.126997 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a333f819-7e0b-44db-996a-155e376e60e5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:55.133241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a333f819-7e0b-44db-996a-155e376e60e5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:55.133690 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a333f819-7e0b-44db-996a-155e376e60e5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:55.134460 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a333f819-7e0b-44db-996a-155e376e60e5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:55.134897 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a333f819-7e0b-44db-996a-155e376e60e5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:55.265602 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a333f819-7e0b-44db-996a-155e376e60e5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:55.274266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a333f819-7e0b-44db-996a-155e376e60e5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.152610 Jul 26 16:37:55.274824 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 271/556] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:55 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:55.717295 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-79187670-b7d2-4579-a022-0909d7ccf262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:55.717994 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-79187670-b7d2-4579-a022-0909d7ccf262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:55.724241 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79187670-b7d2-4579-a022-0909d7ccf262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:55.724719 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79187670-b7d2-4579-a022-0909d7ccf262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:55.725510 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79187670-b7d2-4579-a022-0909d7ccf262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:55.725954 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-79187670-b7d2-4579-a022-0909d7ccf262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:55.854739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-79187670-b7d2-4579-a022-0909d7ccf262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:55.863180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-79187670-b7d2-4579-a022-0909d7ccf262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:55.864762 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-79187670-b7d2-4579-a022-0909d7ccf262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:55.868730 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-79187670-b7d2-4579-a022-0909d7ccf262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1724 microversion: 2.20 time: 0.153466 Jul 26 16:37:55.868730 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 286/557] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:55 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:56.296264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-20c77a36-2502-4c04-a086-8b857a083ff6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:56.296886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-20c77a36-2502-4c04-a086-8b857a083ff6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:56.304695 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20c77a36-2502-4c04-a086-8b857a083ff6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:56.305141 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20c77a36-2502-4c04-a086-8b857a083ff6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:56.305894 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20c77a36-2502-4c04-a086-8b857a083ff6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:56.306385 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20c77a36-2502-4c04-a086-8b857a083ff6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:56.431298 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-20c77a36-2502-4c04-a086-8b857a083ff6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:56.439118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-20c77a36-2502-4c04-a086-8b857a083ff6 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.146724 Jul 26 16:37:56.439680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 272/558] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:56 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:56.889334 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-80ca5f33-56dd-4f8b-86fd-f4509e4dd626 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:56.889942 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-80ca5f33-56dd-4f8b-86fd-f4509e4dd626 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:56.896963 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80ca5f33-56dd-4f8b-86fd-f4509e4dd626 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:56.897412 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80ca5f33-56dd-4f8b-86fd-f4509e4dd626 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:56.898428 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80ca5f33-56dd-4f8b-86fd-f4509e4dd626 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:56.898861 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80ca5f33-56dd-4f8b-86fd-f4509e4dd626 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:57.029104 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80ca5f33-56dd-4f8b-86fd-f4509e4dd626 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:57.037458 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80ca5f33-56dd-4f8b-86fd-f4509e4dd626 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:57.038969 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80ca5f33-56dd-4f8b-86fd-f4509e4dd626 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:57.040111 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-80ca5f33-56dd-4f8b-86fd-f4509e4dd626 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1724 microversion: 2.20 time: 0.154723 Jul 26 16:37:57.040703 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 287/559] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:56 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:57.459639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-78720f9b-eb6a-4910-aa05-6567475b1bcb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:57.460240 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-78720f9b-eb6a-4910-aa05-6567475b1bcb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:57.466732 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78720f9b-eb6a-4910-aa05-6567475b1bcb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:57.467179 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78720f9b-eb6a-4910-aa05-6567475b1bcb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:57.467937 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78720f9b-eb6a-4910-aa05-6567475b1bcb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:57.468368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78720f9b-eb6a-4910-aa05-6567475b1bcb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:57.595181 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-78720f9b-eb6a-4910-aa05-6567475b1bcb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:57.603131 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-78720f9b-eb6a-4910-aa05-6567475b1bcb tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.147491 Jul 26 16:37:57.603727 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 273/560] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:57 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:37:58.063493 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-31f5dde8-7878-4bdc-8c41-708ebcbe5669 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:58.064116 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-31f5dde8-7878-4bdc-8c41-708ebcbe5669 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:58.070797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-31f5dde8-7878-4bdc-8c41-708ebcbe5669 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:58.071296 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-31f5dde8-7878-4bdc-8c41-708ebcbe5669 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:58.072037 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-31f5dde8-7878-4bdc-8c41-708ebcbe5669 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:58.072489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-31f5dde8-7878-4bdc-8c41-708ebcbe5669 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:58.205498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-31f5dde8-7878-4bdc-8c41-708ebcbe5669 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:58.210734 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-31f5dde8-7878-4bdc-8c41-708ebcbe5669 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:58.212279 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-31f5dde8-7878-4bdc-8c41-708ebcbe5669 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:58.213450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-31f5dde8-7878-4bdc-8c41-708ebcbe5669 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1727 microversion: 2.20 time: 0.153880 Jul 26 16:37:58.214008 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 288/561] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:58 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:37:58.239320 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-72436d9f-e6f1-447f-a799-4d0a7bbaffa0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fca2ad1-5c52-42a9-87be-30dda24f9902"}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:37:58.241754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-72436d9f-e6f1-447f-a799-4d0a7bbaffa0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:58.247644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-72436d9f-e6f1-447f-a799-4d0a7bbaffa0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:58.248100 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-72436d9f-e6f1-447f-a799-4d0a7bbaffa0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:58.248885 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-72436d9f-e6f1-447f-a799-4d0a7bbaffa0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:58.249319 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-72436d9f-e6f1-447f-a799-4d0a7bbaffa0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:58.624247 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b6030115-49fa-497d-a0af-18a050b54f41 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:58.624925 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b6030115-49fa-497d-a0af-18a050b54f41 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:58.631620 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b6030115-49fa-497d-a0af-18a050b54f41 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:58.632074 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b6030115-49fa-497d-a0af-18a050b54f41 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:58.632874 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b6030115-49fa-497d-a0af-18a050b54f41 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:58.633312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b6030115-49fa-497d-a0af-18a050b54f41 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:58.764665 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b6030115-49fa-497d-a0af-18a050b54f41 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:58.773533 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b6030115-49fa-497d-a0af-18a050b54f41 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1739 microversion: 2.1 time: 0.153057 Jul 26 16:37:58.774102 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 289/562] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:58 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:37:59.431363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-72436d9f-e6f1-447f-a799-4d0a7bbaffa0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "POST /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.196054 Jul 26 16:37:59.431973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 274/563] 10.222.0.144 () {62 vars in 1369 bytes} [Tue Jul 26 16:37:58 2022] POST /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments => generated 188 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:37:59.553309 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-59518ad5-68fb-4ee7-a62a-95bc4858e5b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:37:59.561344 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-59518ad5-68fb-4ee7-a62a-95bc4858e5b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:59.561344 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59518ad5-68fb-4ee7-a62a-95bc4858e5b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:59.561722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59518ad5-68fb-4ee7-a62a-95bc4858e5b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:59.562644 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59518ad5-68fb-4ee7-a62a-95bc4858e5b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:59.563281 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59518ad5-68fb-4ee7-a62a-95bc4858e5b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:59.675635 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:59.794233 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-79bc9225-2bf6-47ac-9b7b-e1df96355dca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:59.794846 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-79bc9225-2bf6-47ac-9b7b-e1df96355dca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:59.802012 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-79bc9225-2bf6-47ac-9b7b-e1df96355dca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:59.802461 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-79bc9225-2bf6-47ac-9b7b-e1df96355dca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:59.803214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-79bc9225-2bf6-47ac-9b7b-e1df96355dca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:59.803646 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-79bc9225-2bf6-47ac-9b7b-e1df96355dca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:59.820999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:37:59.874391 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-59518ad5-68fb-4ee7-a62a-95bc4858e5b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "POST /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/action" status: 202 len: 0 microversion: 2.20 time: 0.325277 Jul 26 16:37:59.875315 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 290/564] 10.222.0.144 () {62 vars in 1324 bytes} [Tue Jul 26 16:37:59 2022] POST /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:37:59.883455 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b3e4adec-9371-4c35-9358-9ccde34d01ce tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:37:59.884175 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b3e4adec-9371-4c35-9358-9ccde34d01ce tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:37:59.890974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3e4adec-9371-4c35-9358-9ccde34d01ce tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:59.892076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3e4adec-9371-4c35-9358-9ccde34d01ce tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:59.893944 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3e4adec-9371-4c35-9358-9ccde34d01ce tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:37:59.893944 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b3e4adec-9371-4c35-9358-9ccde34d01ce tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:37:59.937305 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-79bc9225-2bf6-47ac-9b7b-e1df96355dca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:37:59.945330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-79bc9225-2bf6-47ac-9b7b-e1df96355dca tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1719 microversion: 2.1 time: 0.154818 Jul 26 16:37:59.946104 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 275/565] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:37:59 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:38:00.008982 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ead1f01b-ca92-4058-8cc6-3b7b930d2e48 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:00.009652 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ead1f01b-ca92-4058-8cc6-3b7b930d2e48 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:00.017019 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ead1f01b-ca92-4058-8cc6-3b7b930d2e48 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:00.017482 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ead1f01b-ca92-4058-8cc6-3b7b930d2e48 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:00.018256 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ead1f01b-ca92-4058-8cc6-3b7b930d2e48 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:00.018875 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ead1f01b-ca92-4058-8cc6-3b7b930d2e48 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:00.039729 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b3e4adec-9371-4c35-9358-9ccde34d01ce tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:00.049316 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b3e4adec-9371-4c35-9358-9ccde34d01ce tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:00.051153 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b3e4adec-9371-4c35-9358-9ccde34d01ce tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:00.052417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b3e4adec-9371-4c35-9358-9ccde34d01ce tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1753 microversion: 2.20 time: 0.172807 Jul 26 16:38:00.060864 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 291/566] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:37:59 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:38:00.150770 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-ead1f01b-ca92-4058-8cc6-3b7b930d2e48 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] HTTP exception thrown: Cannot 'detach_volume' instance 7b3a6262-8adc-4597-8d00-35af06cee7de while it is in vm_state rescued Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ead1f01b-ca92-4058-8cc6-3b7b930d2e48 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Request method failure captured: Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: DELETE /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments/dd88420c-63e1-453c-bcf7-1f05274aeb14 HTTP/1.1 Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BcttderPmzD14SOzevUatQn_f-KHC5OwGIojgRdyaUAc4Q1splEtFnf0Amz--8kn0btqR7qNv-Oau7NZOr9CIrJ1ECpBFaPA389wG3XOEox8RN_ElBs6FWCM-M77RP2f4-NCuQPVbu8Asiz1iIG5mD8gksIoGny2uALegpP_gIpua4 Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 08a954085f8f454698c55faa9351ad6e Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:38:00.152368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_08a954085f8f454698c55faa9351ad6e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 08a954085f8f454698c55faa9351ad6e Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-ServerRescueNegativeTestJSON-450575223-project Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 07e70b1c968443eab469777283b8fb50 Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-ServerRescueNegativeTestJSON-450575223-project Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:38:00.153731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Cannot 'detach_volume' instance 7b3a6262-8adc-4597-8d00-35af06cee7de while it is in vm_state rescued Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'server_id': '7b3a6262-8adc-4597-8d00-35af06cee7de', 'id': 'dd88420c-63e1-453c-bcf7-1f05274aeb14'} Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7b3a6262-8adc-4597-8d00-35af06cee7de in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:38:00.154492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7b3a6262-8adc-4597-8d00-35af06cee7de while it is in vm_state rescued Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7b3a6262-8adc-4597-8d00-35af06cee7de while it is in vm_state rescued Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:38:00.156173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ead1f01b-ca92-4058-8cc6-3b7b930d2e48 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Returning 409 to user: Cannot 'detach_volume' instance 7b3a6262-8adc-4597-8d00-35af06cee7de while it is in vm_state rescued {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:38:00.157130 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ead1f01b-ca92-4058-8cc6-3b7b930d2e48 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "DELETE /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments/dd88420c-63e1-453c-bcf7-1f05274aeb14" status: 409 len: 152 microversion: 2.1 time: 0.149085 Jul 26 16:38:00.157130 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 276/567] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:38:00 2022] DELETE /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments/dd88420c-63e1-453c-bcf7-1f05274aeb14 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 26 16:38:00.162828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a8913dfa-a513-4c26-8ed4-78c2247f4148 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:00.163370 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a8913dfa-a513-4c26-8ed4-78c2247f4148 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:00.169349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a8913dfa-a513-4c26-8ed4-78c2247f4148 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:00.169798 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a8913dfa-a513-4c26-8ed4-78c2247f4148 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:00.170561 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a8913dfa-a513-4c26-8ed4-78c2247f4148 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:00.170993 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a8913dfa-a513-4c26-8ed4-78c2247f4148 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:00.480735 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a8913dfa-a513-4c26-8ed4-78c2247f4148 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "POST /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/action" status: 202 len: 0 microversion: 2.1 time: 0.321489 Jul 26 16:38:00.481290 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 292/568] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:38:00 2022] POST /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:38:00.495061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-aef64fde-cdf3-4dcc-bae6-ca3c2eccd8f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:00.495473 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-aef64fde-cdf3-4dcc-bae6-ca3c2eccd8f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:00.503480 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aef64fde-cdf3-4dcc-bae6-ca3c2eccd8f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:00.503967 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aef64fde-cdf3-4dcc-bae6-ca3c2eccd8f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:00.504736 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aef64fde-cdf3-4dcc-bae6-ca3c2eccd8f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:00.505179 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aef64fde-cdf3-4dcc-bae6-ca3c2eccd8f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:00.673591 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-aef64fde-cdf3-4dcc-bae6-ca3c2eccd8f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:00.684773 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-aef64fde-cdf3-4dcc-bae6-ca3c2eccd8f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1727 microversion: 2.1 time: 0.198454 Jul 26 16:38:00.685649 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 277/569] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:00 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1727 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:01.078015 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-80f3dda4-662b-48d2-a551-59777490e5f8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:01.078763 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-80f3dda4-662b-48d2-a551-59777490e5f8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:01.086040 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80f3dda4-662b-48d2-a551-59777490e5f8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:01.086487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80f3dda4-662b-48d2-a551-59777490e5f8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:01.087254 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80f3dda4-662b-48d2-a551-59777490e5f8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:01.087692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80f3dda4-662b-48d2-a551-59777490e5f8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:01.222625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80f3dda4-662b-48d2-a551-59777490e5f8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:01.231486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80f3dda4-662b-48d2-a551-59777490e5f8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:01.233017 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80f3dda4-662b-48d2-a551-59777490e5f8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:01.234345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-80f3dda4-662b-48d2-a551-59777490e5f8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1753 microversion: 2.20 time: 0.160448 Jul 26 16:38:01.248512 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 293/570] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:01 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:38:01.707698 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3006bb25-a3cf-47f7-91a0-02ba932d7c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:01.708303 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3006bb25-a3cf-47f7-91a0-02ba932d7c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:01.714827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3006bb25-a3cf-47f7-91a0-02ba932d7c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:01.715279 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3006bb25-a3cf-47f7-91a0-02ba932d7c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:01.716041 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3006bb25-a3cf-47f7-91a0-02ba932d7c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:01.716509 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3006bb25-a3cf-47f7-91a0-02ba932d7c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:01.847361 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3006bb25-a3cf-47f7-91a0-02ba932d7c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:01.855351 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3006bb25-a3cf-47f7-91a0-02ba932d7c4e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1727 microversion: 2.1 time: 0.152078 Jul 26 16:38:01.855910 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 278/571] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:01 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:02.258358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-12cc062b-310d-4e34-ba69-b4e2127fce12 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:02.258868 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-12cc062b-310d-4e34-ba69-b4e2127fce12 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:02.265267 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-12cc062b-310d-4e34-ba69-b4e2127fce12 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:02.265711 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-12cc062b-310d-4e34-ba69-b4e2127fce12 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:02.267082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-12cc062b-310d-4e34-ba69-b4e2127fce12 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:02.267517 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-12cc062b-310d-4e34-ba69-b4e2127fce12 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:02.392594 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-12cc062b-310d-4e34-ba69-b4e2127fce12 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:02.401375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-12cc062b-310d-4e34-ba69-b4e2127fce12 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:02.402909 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-12cc062b-310d-4e34-ba69-b4e2127fce12 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:02.404046 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-12cc062b-310d-4e34-ba69-b4e2127fce12 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1755 microversion: 2.20 time: 0.149814 Jul 26 16:38:02.404634 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 294/572] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:02 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1755 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:02.877743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-532eb5e8-9262-41de-a5e3-d3ab85941c36 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:02.878348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-532eb5e8-9262-41de-a5e3-d3ab85941c36 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:02.884927 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-532eb5e8-9262-41de-a5e3-d3ab85941c36 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:02.885371 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-532eb5e8-9262-41de-a5e3-d3ab85941c36 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:02.886126 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-532eb5e8-9262-41de-a5e3-d3ab85941c36 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:02.886559 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-532eb5e8-9262-41de-a5e3-d3ab85941c36 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:03.011689 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-532eb5e8-9262-41de-a5e3-d3ab85941c36 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:03.020043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-532eb5e8-9262-41de-a5e3-d3ab85941c36 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1727 microversion: 2.1 time: 0.146692 Jul 26 16:38:03.020642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 279/573] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:02 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:03.426367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-46eb692e-3ba0-421b-bbb8-faeac8d57ec9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:03.427114 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-46eb692e-3ba0-421b-bbb8-faeac8d57ec9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:03.434990 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-46eb692e-3ba0-421b-bbb8-faeac8d57ec9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:03.435427 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-46eb692e-3ba0-421b-bbb8-faeac8d57ec9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:03.436184 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-46eb692e-3ba0-421b-bbb8-faeac8d57ec9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:03.436635 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-46eb692e-3ba0-421b-bbb8-faeac8d57ec9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:03.567529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-46eb692e-3ba0-421b-bbb8-faeac8d57ec9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:03.576001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-46eb692e-3ba0-421b-bbb8-faeac8d57ec9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:03.577520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-46eb692e-3ba0-421b-bbb8-faeac8d57ec9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:03.578655 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-46eb692e-3ba0-421b-bbb8-faeac8d57ec9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1755 microversion: 2.20 time: 0.156512 Jul 26 16:38:03.579728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 295/574] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:03 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:04.041977 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-46fd2824-04a8-4464-98f0-642b33a68901 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:04.042612 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-46fd2824-04a8-4464-98f0-642b33a68901 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:04.049109 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-46fd2824-04a8-4464-98f0-642b33a68901 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:04.049559 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-46fd2824-04a8-4464-98f0-642b33a68901 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:04.050318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-46fd2824-04a8-4464-98f0-642b33a68901 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:04.050753 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-46fd2824-04a8-4464-98f0-642b33a68901 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:04.177661 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-46fd2824-04a8-4464-98f0-642b33a68901 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:04.185518 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-46fd2824-04a8-4464-98f0-642b33a68901 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1727 microversion: 2.1 time: 0.147373 Jul 26 16:38:04.186107 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 280/575] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:04 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:04.601824 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-267b7fa4-7eeb-48c2-aed4-5386c42a90e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:04.602415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-267b7fa4-7eeb-48c2-aed4-5386c42a90e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:04.608796 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-267b7fa4-7eeb-48c2-aed4-5386c42a90e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:04.609240 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-267b7fa4-7eeb-48c2-aed4-5386c42a90e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:04.609989 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-267b7fa4-7eeb-48c2-aed4-5386c42a90e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:04.611064 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-267b7fa4-7eeb-48c2-aed4-5386c42a90e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:04.737421 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-267b7fa4-7eeb-48c2-aed4-5386c42a90e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:04.745707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-267b7fa4-7eeb-48c2-aed4-5386c42a90e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:04.747324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-267b7fa4-7eeb-48c2-aed4-5386c42a90e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:04.748533 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-267b7fa4-7eeb-48c2-aed4-5386c42a90e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1755 microversion: 2.20 time: 0.150675 Jul 26 16:38:04.749074 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 296/576] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:04 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1755 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:05.207657 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d098acf7-3d53-4831-b592-5317563a7e1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:05.208302 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d098acf7-3d53-4831-b592-5317563a7e1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:05.214915 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d098acf7-3d53-4831-b592-5317563a7e1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:05.215371 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d098acf7-3d53-4831-b592-5317563a7e1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:05.216136 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d098acf7-3d53-4831-b592-5317563a7e1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:05.216616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d098acf7-3d53-4831-b592-5317563a7e1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:05.350455 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d098acf7-3d53-4831-b592-5317563a7e1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:05.358382 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d098acf7-3d53-4831-b592-5317563a7e1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1727 microversion: 2.1 time: 0.155043 Jul 26 16:38:05.359140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 281/577] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:05 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:05.771609 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c711b797-f5fc-4109-aa74-a4746e805d54 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:05.772163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c711b797-f5fc-4109-aa74-a4746e805d54 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:05.778836 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c711b797-f5fc-4109-aa74-a4746e805d54 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:05.779282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c711b797-f5fc-4109-aa74-a4746e805d54 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:05.780041 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c711b797-f5fc-4109-aa74-a4746e805d54 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:05.780502 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c711b797-f5fc-4109-aa74-a4746e805d54 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:05.909413 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c711b797-f5fc-4109-aa74-a4746e805d54 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:05.918089 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c711b797-f5fc-4109-aa74-a4746e805d54 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:05.919635 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c711b797-f5fc-4109-aa74-a4746e805d54 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:05.920878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c711b797-f5fc-4109-aa74-a4746e805d54 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1755 microversion: 2.20 time: 0.153207 Jul 26 16:38:05.921431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 297/578] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:05 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1755 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:06.379349 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1c2a7115-1b8d-4d40-bcd8-0123e9cd815e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:06.380654 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1c2a7115-1b8d-4d40-bcd8-0123e9cd815e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:06.387638 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1c2a7115-1b8d-4d40-bcd8-0123e9cd815e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:06.388344 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1c2a7115-1b8d-4d40-bcd8-0123e9cd815e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:06.389369 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1c2a7115-1b8d-4d40-bcd8-0123e9cd815e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:06.390016 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1c2a7115-1b8d-4d40-bcd8-0123e9cd815e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:06.612901 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1c2a7115-1b8d-4d40-bcd8-0123e9cd815e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:06.620871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1c2a7115-1b8d-4d40-bcd8-0123e9cd815e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1733 microversion: 2.1 time: 0.245314 Jul 26 16:38:06.621441 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 282/579] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:06 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1733 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:06.642963 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dde8ed2c-bea5-4cf5-8895-4148e361a5ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:06.643377 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dde8ed2c-bea5-4cf5-8895-4148e361a5ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:06.650781 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dde8ed2c-bea5-4cf5-8895-4148e361a5ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:06.651230 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dde8ed2c-bea5-4cf5-8895-4148e361a5ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:06.651992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dde8ed2c-bea5-4cf5-8895-4148e361a5ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:06.652437 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dde8ed2c-bea5-4cf5-8895-4148e361a5ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:06.732675 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dde8ed2c-bea5-4cf5-8895-4148e361a5ce tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094347 Jul 26 16:38:06.733271 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 298/580] 10.222.0.144 () {58 vars in 1280 bytes} [Tue Jul 26 16:38:06 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:38:06.943620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-eee65369-f7fa-4f7d-abc7-52b168a98e19 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:06.944503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-eee65369-f7fa-4f7d-abc7-52b168a98e19 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:06.950755 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eee65369-f7fa-4f7d-abc7-52b168a98e19 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:06.951285 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eee65369-f7fa-4f7d-abc7-52b168a98e19 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:06.952120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eee65369-f7fa-4f7d-abc7-52b168a98e19 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:06.952658 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eee65369-f7fa-4f7d-abc7-52b168a98e19 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:07.112172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-eee65369-f7fa-4f7d-abc7-52b168a98e19 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:07.121064 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-eee65369-f7fa-4f7d-abc7-52b168a98e19 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:07.122579 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-eee65369-f7fa-4f7d-abc7-52b168a98e19 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:07.123756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-eee65369-f7fa-4f7d-abc7-52b168a98e19 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.184010 Jul 26 16:38:07.124313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 283/581] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:06 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:08.053191 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-868d4933-3456-4d60-bc6c-c0eeb352e553 req-78ef0ddc-ab7b-4a5b-ac47-7ccc1faccc63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3a6262-8adc-4597-8d00-35af06cee7de", "tag": "b93e292a-28ec-4647-a984-c0d6bb8814e5"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:08.065395 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-868d4933-3456-4d60-bc6c-c0eeb352e553 req-78ef0ddc-ab7b-4a5b-ac47-7ccc1faccc63 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:08.065832 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-868d4933-3456-4d60-bc6c-c0eeb352e553 req-78ef0ddc-ab7b-4a5b-ac47-7ccc1faccc63 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:08.078286 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-868d4933-3456-4d60-bc6c-c0eeb352e553 req-78ef0ddc-ab7b-4a5b-ac47-7ccc1faccc63 service nova] Creating event network-changed:b93e292a-28ec-4647-a984-c0d6bb8814e5 for instance 7b3a6262-8adc-4597-8d00-35af06cee7de on hv-cinder-85104 Jul 26 16:38:08.086165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-868d4933-3456-4d60-bc6c-c0eeb352e553 req-78ef0ddc-ab7b-4a5b-ac47-7ccc1faccc63 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038900 Jul 26 16:38:08.086931 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 299/582] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:38:08.147604 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6460bb0b-5314-439c-af51-cc249f238bb1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:08.148615 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6460bb0b-5314-439c-af51-cc249f238bb1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:08.155636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6460bb0b-5314-439c-af51-cc249f238bb1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:08.156531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6460bb0b-5314-439c-af51-cc249f238bb1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:08.157951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6460bb0b-5314-439c-af51-cc249f238bb1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:08.158553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6460bb0b-5314-439c-af51-cc249f238bb1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:08.317534 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6460bb0b-5314-439c-af51-cc249f238bb1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:08.326729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6460bb0b-5314-439c-af51-cc249f238bb1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:08.328528 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6460bb0b-5314-439c-af51-cc249f238bb1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:08.331140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6460bb0b-5314-439c-af51-cc249f238bb1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.187333 Jul 26 16:38:08.332514 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 284/583] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:08 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:09.355010 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-81bd2bc1-e4da-4e7f-b463-04e828f6c74b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:09.355742 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-81bd2bc1-e4da-4e7f-b463-04e828f6c74b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:09.364179 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-81bd2bc1-e4da-4e7f-b463-04e828f6c74b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:09.364652 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-81bd2bc1-e4da-4e7f-b463-04e828f6c74b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:09.365423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-81bd2bc1-e4da-4e7f-b463-04e828f6c74b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:09.365857 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-81bd2bc1-e4da-4e7f-b463-04e828f6c74b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:09.529770 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-81bd2bc1-e4da-4e7f-b463-04e828f6c74b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:09.532079 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-81bd2bc1-e4da-4e7f-b463-04e828f6c74b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:09.534292 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-81bd2bc1-e4da-4e7f-b463-04e828f6c74b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:09.535482 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-81bd2bc1-e4da-4e7f-b463-04e828f6c74b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.184777 Jul 26 16:38:09.536067 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 300/584] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:09 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:10.100566 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-8ae3c886-536c-42af-971f-69ecc44f51c2 req-261be5ea-f52d-4ba0-a565-f7d4a6485996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b3a6262-8adc-4597-8d00-35af06cee7de", "tag": "b93e292a-28ec-4647-a984-c0d6bb8814e5"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:10.111373 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-8ae3c886-536c-42af-971f-69ecc44f51c2 req-261be5ea-f52d-4ba0-a565-f7d4a6485996 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:10.111813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-8ae3c886-536c-42af-971f-69ecc44f51c2 req-261be5ea-f52d-4ba0-a565-f7d4a6485996 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:10.122492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-8ae3c886-536c-42af-971f-69ecc44f51c2 req-261be5ea-f52d-4ba0-a565-f7d4a6485996 service nova] Creating event network-changed:b93e292a-28ec-4647-a984-c0d6bb8814e5 for instance 7b3a6262-8adc-4597-8d00-35af06cee7de on hv-cinder-85104 Jul 26 16:38:10.128058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-8ae3c886-536c-42af-971f-69ecc44f51c2 req-261be5ea-f52d-4ba0-a565-f7d4a6485996 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031117 Jul 26 16:38:10.128661 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 285/585] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:38:10.559219 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e351ab24-9b82-4fcf-b047-f3c18b33768d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:10.559830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e351ab24-9b82-4fcf-b047-f3c18b33768d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:10.566518 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e351ab24-9b82-4fcf-b047-f3c18b33768d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:10.566959 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e351ab24-9b82-4fcf-b047-f3c18b33768d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:10.568010 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e351ab24-9b82-4fcf-b047-f3c18b33768d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:10.568469 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e351ab24-9b82-4fcf-b047-f3c18b33768d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:10.713136 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e351ab24-9b82-4fcf-b047-f3c18b33768d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:10.722230 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e351ab24-9b82-4fcf-b047-f3c18b33768d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:10.723735 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e351ab24-9b82-4fcf-b047-f3c18b33768d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:10.724927 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e351ab24-9b82-4fcf-b047-f3c18b33768d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.169759 Jul 26 16:38:10.725474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 301/586] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:10 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:11.749345 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-17cb372a-b513-425e-bfa3-0c1d84563f6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:11.749973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-17cb372a-b513-425e-bfa3-0c1d84563f6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:11.756375 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17cb372a-b513-425e-bfa3-0c1d84563f6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:11.757129 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17cb372a-b513-425e-bfa3-0c1d84563f6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:11.758090 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17cb372a-b513-425e-bfa3-0c1d84563f6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:11.758531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17cb372a-b513-425e-bfa3-0c1d84563f6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:11.901524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-17cb372a-b513-425e-bfa3-0c1d84563f6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:11.910966 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-17cb372a-b513-425e-bfa3-0c1d84563f6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:11.912538 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-17cb372a-b513-425e-bfa3-0c1d84563f6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:11.913706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-17cb372a-b513-425e-bfa3-0c1d84563f6a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.169277 Jul 26 16:38:11.914259 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 286/587] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:11 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:12.939049 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2a5d8a9f-aeb3-48df-a337-47f0f5dfe013 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:12.939946 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2a5d8a9f-aeb3-48df-a337-47f0f5dfe013 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:12.946677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2a5d8a9f-aeb3-48df-a337-47f0f5dfe013 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:12.947128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2a5d8a9f-aeb3-48df-a337-47f0f5dfe013 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:12.947913 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2a5d8a9f-aeb3-48df-a337-47f0f5dfe013 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:12.948344 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2a5d8a9f-aeb3-48df-a337-47f0f5dfe013 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:13.090480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2a5d8a9f-aeb3-48df-a337-47f0f5dfe013 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:13.099586 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2a5d8a9f-aeb3-48df-a337-47f0f5dfe013 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:13.101115 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2a5d8a9f-aeb3-48df-a337-47f0f5dfe013 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:13.102265 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2a5d8a9f-aeb3-48df-a337-47f0f5dfe013 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.168329 Jul 26 16:38:13.103031 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 302/588] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:12 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:14.124921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d1b7cc62-e198-4abb-b5ec-f23033695b58 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:14.126892 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d1b7cc62-e198-4abb-b5ec-f23033695b58 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:14.133336 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d1b7cc62-e198-4abb-b5ec-f23033695b58 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:14.133786 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d1b7cc62-e198-4abb-b5ec-f23033695b58 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:14.134539 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d1b7cc62-e198-4abb-b5ec-f23033695b58 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:14.134971 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d1b7cc62-e198-4abb-b5ec-f23033695b58 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:14.283943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d1b7cc62-e198-4abb-b5ec-f23033695b58 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:14.292465 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d1b7cc62-e198-4abb-b5ec-f23033695b58 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:14.294078 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d1b7cc62-e198-4abb-b5ec-f23033695b58 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:14.295228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d1b7cc62-e198-4abb-b5ec-f23033695b58 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.174547 Jul 26 16:38:14.295772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 287/589] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:14 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:15.320153 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-80b70e7f-b881-411b-82af-010d7afbb04c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:15.320875 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-80b70e7f-b881-411b-82af-010d7afbb04c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:15.327356 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80b70e7f-b881-411b-82af-010d7afbb04c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:15.327800 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80b70e7f-b881-411b-82af-010d7afbb04c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:15.328601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80b70e7f-b881-411b-82af-010d7afbb04c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:15.329786 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80b70e7f-b881-411b-82af-010d7afbb04c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:15.469028 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80b70e7f-b881-411b-82af-010d7afbb04c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:15.482396 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80b70e7f-b881-411b-82af-010d7afbb04c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:15.484112 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80b70e7f-b881-411b-82af-010d7afbb04c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:15.485414 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-80b70e7f-b881-411b-82af-010d7afbb04c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.169657 Jul 26 16:38:15.486204 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 303/590] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:15 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:15.966390 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-eb4ec60b-15f6-423c-bb28-3e4e17005168 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:15.967739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-eb4ec60b-15f6-423c-bb28-3e4e17005168 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:15.974536 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eb4ec60b-15f6-423c-bb28-3e4e17005168 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:15.975348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eb4ec60b-15f6-423c-bb28-3e4e17005168 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:15.976244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eb4ec60b-15f6-423c-bb28-3e4e17005168 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:15.976740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eb4ec60b-15f6-423c-bb28-3e4e17005168 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:16.058926 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-eb4ec60b-15f6-423c-bb28-3e4e17005168 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lazy-loading 'services' on Instance uuid 4a999303-ed3e-4e86-b4f3-4d04e1aec162 {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:38:16.296447 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-eb4ec60b-15f6-423c-bb28-3e4e17005168 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "DELETE /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/os-volume_attachments/2d311159-3729-4b04-8936-b3d3fb42a575" status: 202 len: 0 microversion: 2.1 time: 0.472914 Jul 26 16:38:16.297044 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 288/591] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:38:15 2022] DELETE /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/os-volume_attachments/2d311159-3729-4b04-8936-b3d3fb42a575 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:38:16.510788 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f8b97f7e-2dfe-4fa3-a797-68e38179dd29 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:16.511386 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f8b97f7e-2dfe-4fa3-a797-68e38179dd29 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:16.518538 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8b97f7e-2dfe-4fa3-a797-68e38179dd29 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:16.518984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8b97f7e-2dfe-4fa3-a797-68e38179dd29 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:16.519751 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8b97f7e-2dfe-4fa3-a797-68e38179dd29 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:16.520187 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8b97f7e-2dfe-4fa3-a797-68e38179dd29 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:16.669082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f8b97f7e-2dfe-4fa3-a797-68e38179dd29 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:16.677949 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f8b97f7e-2dfe-4fa3-a797-68e38179dd29 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:16.679463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f8b97f7e-2dfe-4fa3-a797-68e38179dd29 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:16.680652 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f8b97f7e-2dfe-4fa3-a797-68e38179dd29 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.173787 Jul 26 16:38:16.681395 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 304/592] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:16 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:17.704729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2ea7927c-4b5a-4f5c-8ac8-be2143723022 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:17.707613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2ea7927c-4b5a-4f5c-8ac8-be2143723022 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:17.711605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2ea7927c-4b5a-4f5c-8ac8-be2143723022 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:17.712053 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2ea7927c-4b5a-4f5c-8ac8-be2143723022 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:17.712856 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2ea7927c-4b5a-4f5c-8ac8-be2143723022 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:17.713296 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2ea7927c-4b5a-4f5c-8ac8-be2143723022 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:17.838656 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2ea7927c-4b5a-4f5c-8ac8-be2143723022 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:17.846936 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2ea7927c-4b5a-4f5c-8ac8-be2143723022 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:17.848514 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2ea7927c-4b5a-4f5c-8ac8-be2143723022 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:17.849656 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2ea7927c-4b5a-4f5c-8ac8-be2143723022 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.150270 Jul 26 16:38:17.850211 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 289/593] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:17 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:18.872684 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1419f0cf-a828-4501-96a1-5a6b0a49d907 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:18.873284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1419f0cf-a828-4501-96a1-5a6b0a49d907 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:18.876206 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=56 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:38:18.880931 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1419f0cf-a828-4501-96a1-5a6b0a49d907 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:18.881373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1419f0cf-a828-4501-96a1-5a6b0a49d907 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:18.882150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1419f0cf-a828-4501-96a1-5a6b0a49d907 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:18.882578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1419f0cf-a828-4501-96a1-5a6b0a49d907 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:19.027373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1419f0cf-a828-4501-96a1-5a6b0a49d907 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:19.036287 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1419f0cf-a828-4501-96a1-5a6b0a49d907 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:19.037822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1419f0cf-a828-4501-96a1-5a6b0a49d907 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:19.038979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1419f0cf-a828-4501-96a1-5a6b0a49d907 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.170182 Jul 26 16:38:19.039529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 305/594] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:18 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:20.063016 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8eeca62c-0335-4bcc-ad0b-3b5d053acbaf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:20.064236 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8eeca62c-0335-4bcc-ad0b-3b5d053acbaf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:20.066761 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=50 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:38:20.071729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8eeca62c-0335-4bcc-ad0b-3b5d053acbaf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:20.075176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8eeca62c-0335-4bcc-ad0b-3b5d053acbaf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:20.075176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8eeca62c-0335-4bcc-ad0b-3b5d053acbaf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:20.075176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8eeca62c-0335-4bcc-ad0b-3b5d053acbaf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:20.200177 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8eeca62c-0335-4bcc-ad0b-3b5d053acbaf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:20.208731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8eeca62c-0335-4bcc-ad0b-3b5d053acbaf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:20.210274 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8eeca62c-0335-4bcc-ad0b-3b5d053acbaf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:20.211421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8eeca62c-0335-4bcc-ad0b-3b5d053acbaf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.152396 Jul 26 16:38:20.211986 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 290/595] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:20 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:21.234511 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6039e1d9-d167-40a0-b6e3-cd2674ac63d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:21.235111 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6039e1d9-d167-40a0-b6e3-cd2674ac63d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:21.241722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6039e1d9-d167-40a0-b6e3-cd2674ac63d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:21.242165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6039e1d9-d167-40a0-b6e3-cd2674ac63d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:21.242924 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6039e1d9-d167-40a0-b6e3-cd2674ac63d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:21.243350 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6039e1d9-d167-40a0-b6e3-cd2674ac63d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:21.372159 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6039e1d9-d167-40a0-b6e3-cd2674ac63d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:21.380968 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6039e1d9-d167-40a0-b6e3-cd2674ac63d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:21.382476 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6039e1d9-d167-40a0-b6e3-cd2674ac63d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:21.383610 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6039e1d9-d167-40a0-b6e3-cd2674ac63d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.153012 Jul 26 16:38:21.384165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 306/596] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:21 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:22.406604 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b2e92f65-b0a7-432e-b389-69506b7bd716 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:22.407335 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b2e92f65-b0a7-432e-b389-69506b7bd716 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:22.413370 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b2e92f65-b0a7-432e-b389-69506b7bd716 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:22.413816 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b2e92f65-b0a7-432e-b389-69506b7bd716 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:22.414565 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b2e92f65-b0a7-432e-b389-69506b7bd716 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:22.414993 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b2e92f65-b0a7-432e-b389-69506b7bd716 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:22.543197 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b2e92f65-b0a7-432e-b389-69506b7bd716 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:22.552579 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b2e92f65-b0a7-432e-b389-69506b7bd716 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:22.554083 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b2e92f65-b0a7-432e-b389-69506b7bd716 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:22.555231 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b2e92f65-b0a7-432e-b389-69506b7bd716 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.152617 Jul 26 16:38:22.555772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 291/597] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:22 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:23.577964 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d41d760e-accd-4ba6-b43d-f75369d52b14 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:23.578563 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d41d760e-accd-4ba6-b43d-f75369d52b14 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:23.585615 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d41d760e-accd-4ba6-b43d-f75369d52b14 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:23.586095 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d41d760e-accd-4ba6-b43d-f75369d52b14 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:23.586850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d41d760e-accd-4ba6-b43d-f75369d52b14 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:23.587302 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d41d760e-accd-4ba6-b43d-f75369d52b14 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:23.591209 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:38:23.716543 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d41d760e-accd-4ba6-b43d-f75369d52b14 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:23.725055 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d41d760e-accd-4ba6-b43d-f75369d52b14 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:23.726568 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d41d760e-accd-4ba6-b43d-f75369d52b14 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:23.727704 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d41d760e-accd-4ba6-b43d-f75369d52b14 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.153656 Jul 26 16:38:23.728256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 307/598] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:23 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:24.751656 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cd0a1ee2-36b2-4fa7-85c7-44871a725727 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:24.752215 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cd0a1ee2-36b2-4fa7-85c7-44871a725727 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:24.758792 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd0a1ee2-36b2-4fa7-85c7-44871a725727 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:24.759336 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd0a1ee2-36b2-4fa7-85c7-44871a725727 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:24.760209 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd0a1ee2-36b2-4fa7-85c7-44871a725727 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:24.760749 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd0a1ee2-36b2-4fa7-85c7-44871a725727 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:24.765283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:38:24.832194 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2314cec6-a8ea-4d04-aac8-739d535010f1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:24.839645 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2314cec6-a8ea-4d04-aac8-739d535010f1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:24.840096 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2314cec6-a8ea-4d04-aac8-739d535010f1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:24.906446 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2314cec6-a8ea-4d04-aac8-739d535010f1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Going to try to stop instance {{(pid=124821) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 26 16:38:25.000019 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cd0a1ee2-36b2-4fa7-85c7-44871a725727 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:25.009494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cd0a1ee2-36b2-4fa7-85c7-44871a725727 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:25.010974 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cd0a1ee2-36b2-4fa7-85c7-44871a725727 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:25.012212 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cd0a1ee2-36b2-4fa7-85c7-44871a725727 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.265399 Jul 26 16:38:25.012799 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 292/599] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:24 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:25.088659 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2314cec6-a8ea-4d04-aac8-739d535010f1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/action" status: 202 len: 0 microversion: 2.1 time: 0.261148 Jul 26 16:38:25.089290 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 308/600] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:38:24 2022] POST /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 16:38:25.097451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c69e0afa-030b-40cb-8a8c-0114c9840e88 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:25.098153 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c69e0afa-030b-40cb-8a8c-0114c9840e88 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:25.104109 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c69e0afa-030b-40cb-8a8c-0114c9840e88 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:25.104601 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c69e0afa-030b-40cb-8a8c-0114c9840e88 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:25.105370 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c69e0afa-030b-40cb-8a8c-0114c9840e88 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:25.105806 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c69e0afa-030b-40cb-8a8c-0114c9840e88 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:25.248061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c69e0afa-030b-40cb-8a8c-0114c9840e88 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:25.256212 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c69e0afa-030b-40cb-8a8c-0114c9840e88 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.162586 Jul 26 16:38:25.256875 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 293/601] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:25 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:26.037736 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5250f883-a395-4555-9fcf-9c4ce2587d4f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:26.038431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5250f883-a395-4555-9fcf-9c4ce2587d4f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:26.044615 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5250f883-a395-4555-9fcf-9c4ce2587d4f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:26.045063 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5250f883-a395-4555-9fcf-9c4ce2587d4f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:26.045818 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5250f883-a395-4555-9fcf-9c4ce2587d4f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:26.046251 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5250f883-a395-4555-9fcf-9c4ce2587d4f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:26.176337 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5250f883-a395-4555-9fcf-9c4ce2587d4f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:26.184668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5250f883-a395-4555-9fcf-9c4ce2587d4f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:26.186172 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5250f883-a395-4555-9fcf-9c4ce2587d4f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:26.187314 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5250f883-a395-4555-9fcf-9c4ce2587d4f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.154326 Jul 26 16:38:26.187864 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 309/602] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:26 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:26.277897 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1ffaa1c2-4a6f-4c02-9065-17d0af2b43cb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:26.278447 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1ffaa1c2-4a6f-4c02-9065-17d0af2b43cb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:26.285071 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1ffaa1c2-4a6f-4c02-9065-17d0af2b43cb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:26.285501 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1ffaa1c2-4a6f-4c02-9065-17d0af2b43cb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:26.286257 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1ffaa1c2-4a6f-4c02-9065-17d0af2b43cb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:26.286689 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1ffaa1c2-4a6f-4c02-9065-17d0af2b43cb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:26.412722 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1ffaa1c2-4a6f-4c02-9065-17d0af2b43cb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:26.420088 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1ffaa1c2-4a6f-4c02-9065-17d0af2b43cb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.146327 Jul 26 16:38:26.420680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 294/603] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:26 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:27.210524 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c9fd2ffe-1340-42ce-9bb8-bee21ed8eb52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:27.211126 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c9fd2ffe-1340-42ce-9bb8-bee21ed8eb52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:27.217579 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9fd2ffe-1340-42ce-9bb8-bee21ed8eb52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:27.218051 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9fd2ffe-1340-42ce-9bb8-bee21ed8eb52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:27.218816 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9fd2ffe-1340-42ce-9bb8-bee21ed8eb52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:27.219249 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9fd2ffe-1340-42ce-9bb8-bee21ed8eb52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:27.345796 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c9fd2ffe-1340-42ce-9bb8-bee21ed8eb52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:27.354154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c9fd2ffe-1340-42ce-9bb8-bee21ed8eb52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:27.355664 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c9fd2ffe-1340-42ce-9bb8-bee21ed8eb52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:27.356834 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c9fd2ffe-1340-42ce-9bb8-bee21ed8eb52 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.150335 Jul 26 16:38:27.357382 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 310/604] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:27 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:27.441135 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6d491ea7-f6ee-41f5-b560-1cacbe8e4998 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:27.441739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6d491ea7-f6ee-41f5-b560-1cacbe8e4998 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:27.448106 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d491ea7-f6ee-41f5-b560-1cacbe8e4998 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:27.448581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d491ea7-f6ee-41f5-b560-1cacbe8e4998 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:27.449334 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d491ea7-f6ee-41f5-b560-1cacbe8e4998 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:27.449779 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d491ea7-f6ee-41f5-b560-1cacbe8e4998 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:27.582021 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6d491ea7-f6ee-41f5-b560-1cacbe8e4998 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:27.589549 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6d491ea7-f6ee-41f5-b560-1cacbe8e4998 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.152807 Jul 26 16:38:27.590107 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 295/605] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:27 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:28.379876 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a9f3d403-e0a0-49e4-bf14-35ab4e8ca816 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:28.380495 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a9f3d403-e0a0-49e4-bf14-35ab4e8ca816 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:28.386960 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9f3d403-e0a0-49e4-bf14-35ab4e8ca816 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:28.387401 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9f3d403-e0a0-49e4-bf14-35ab4e8ca816 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:28.388146 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9f3d403-e0a0-49e4-bf14-35ab4e8ca816 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:28.388607 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9f3d403-e0a0-49e4-bf14-35ab4e8ca816 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:28.517156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a9f3d403-e0a0-49e4-bf14-35ab4e8ca816 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:28.525656 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a9f3d403-e0a0-49e4-bf14-35ab4e8ca816 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:28.527289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a9f3d403-e0a0-49e4-bf14-35ab4e8ca816 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:28.528495 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a9f3d403-e0a0-49e4-bf14-35ab4e8ca816 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.153125 Jul 26 16:38:28.529050 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 311/606] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:28 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:28.610966 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9d829aff-5e56-4d02-95ca-c9904c5e94ab tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:28.611612 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9d829aff-5e56-4d02-95ca-c9904c5e94ab tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:28.618070 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d829aff-5e56-4d02-95ca-c9904c5e94ab tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:28.618519 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d829aff-5e56-4d02-95ca-c9904c5e94ab tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:28.619304 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d829aff-5e56-4d02-95ca-c9904c5e94ab tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:28.619740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d829aff-5e56-4d02-95ca-c9904c5e94ab tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:28.744872 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9d829aff-5e56-4d02-95ca-c9904c5e94ab tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:28.752278 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9d829aff-5e56-4d02-95ca-c9904c5e94ab tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.145771 Jul 26 16:38:28.752865 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 296/607] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:28 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:29.551950 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fa7ab32e-5bb7-4607-809a-7a4f27e9f6ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:29.552578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fa7ab32e-5bb7-4607-809a-7a4f27e9f6ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:29.559252 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fa7ab32e-5bb7-4607-809a-7a4f27e9f6ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:29.559695 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fa7ab32e-5bb7-4607-809a-7a4f27e9f6ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:29.560474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fa7ab32e-5bb7-4607-809a-7a4f27e9f6ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:29.560901 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fa7ab32e-5bb7-4607-809a-7a4f27e9f6ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:29.692254 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fa7ab32e-5bb7-4607-809a-7a4f27e9f6ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:29.700637 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fa7ab32e-5bb7-4607-809a-7a4f27e9f6ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:29.702143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fa7ab32e-5bb7-4607-809a-7a4f27e9f6ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:29.703286 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fa7ab32e-5bb7-4607-809a-7a4f27e9f6ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.155272 Jul 26 16:38:29.704374 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 312/608] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:29 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:29.773496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6bd1b154-9ef0-4ce1-92c5-60f15bd23d20 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:29.774292 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6bd1b154-9ef0-4ce1-92c5-60f15bd23d20 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:29.780695 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6bd1b154-9ef0-4ce1-92c5-60f15bd23d20 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:29.781145 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6bd1b154-9ef0-4ce1-92c5-60f15bd23d20 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:29.782562 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6bd1b154-9ef0-4ce1-92c5-60f15bd23d20 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:29.782999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6bd1b154-9ef0-4ce1-92c5-60f15bd23d20 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:29.917211 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6bd1b154-9ef0-4ce1-92c5-60f15bd23d20 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:29.925272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6bd1b154-9ef0-4ce1-92c5-60f15bd23d20 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.155612 Jul 26 16:38:29.925834 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 297/609] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:29 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:30.726577 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7c219c81-1935-4338-a71f-b5a78e8f908f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:30.727179 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7c219c81-1935-4338-a71f-b5a78e8f908f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:30.733753 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7c219c81-1935-4338-a71f-b5a78e8f908f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:30.734198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7c219c81-1935-4338-a71f-b5a78e8f908f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:30.734958 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7c219c81-1935-4338-a71f-b5a78e8f908f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:30.735387 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7c219c81-1935-4338-a71f-b5a78e8f908f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:30.865139 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7c219c81-1935-4338-a71f-b5a78e8f908f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:30.873541 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7c219c81-1935-4338-a71f-b5a78e8f908f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:30.875028 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7c219c81-1935-4338-a71f-b5a78e8f908f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:30.876723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7c219c81-1935-4338-a71f-b5a78e8f908f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.153986 Jul 26 16:38:30.877295 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 313/610] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:30 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:30.946813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-188ad71b-0cdd-4760-b163-b703db7c6f76 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:30.947420 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-188ad71b-0cdd-4760-b163-b703db7c6f76 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:30.954464 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-188ad71b-0cdd-4760-b163-b703db7c6f76 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:30.954915 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-188ad71b-0cdd-4760-b163-b703db7c6f76 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:30.955683 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-188ad71b-0cdd-4760-b163-b703db7c6f76 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:30.956119 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-188ad71b-0cdd-4760-b163-b703db7c6f76 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:31.087285 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-188ad71b-0cdd-4760-b163-b703db7c6f76 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:31.094784 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-188ad71b-0cdd-4760-b163-b703db7c6f76 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.151787 Jul 26 16:38:31.095350 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 298/611] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:30 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:31.899300 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a7fde029-d95a-472f-8c59-2b323f0d4a3c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:31.899901 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a7fde029-d95a-472f-8c59-2b323f0d4a3c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:31.906802 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a7fde029-d95a-472f-8c59-2b323f0d4a3c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:31.907246 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a7fde029-d95a-472f-8c59-2b323f0d4a3c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:31.908005 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a7fde029-d95a-472f-8c59-2b323f0d4a3c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:31.908462 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a7fde029-d95a-472f-8c59-2b323f0d4a3c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:32.038862 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a7fde029-d95a-472f-8c59-2b323f0d4a3c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:32.047079 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a7fde029-d95a-472f-8c59-2b323f0d4a3c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:32.049122 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a7fde029-d95a-472f-8c59-2b323f0d4a3c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:32.050250 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a7fde029-d95a-472f-8c59-2b323f0d4a3c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.155110 Jul 26 16:38:32.050795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 314/612] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:31 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:32.115514 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-54c7897d-1f27-4511-b4c4-b36970628b40 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:32.116120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-54c7897d-1f27-4511-b4c4-b36970628b40 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:32.122498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-54c7897d-1f27-4511-b4c4-b36970628b40 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:32.122947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-54c7897d-1f27-4511-b4c4-b36970628b40 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:32.123702 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-54c7897d-1f27-4511-b4c4-b36970628b40 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:32.124134 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-54c7897d-1f27-4511-b4c4-b36970628b40 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:32.250084 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-54c7897d-1f27-4511-b4c4-b36970628b40 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:32.257821 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-54c7897d-1f27-4511-b4c4-b36970628b40 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.146184 Jul 26 16:38:32.258382 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 299/613] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:32 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:33.072063 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-db14eae8-490c-48f3-881b-6b538df29258 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:33.072682 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-db14eae8-490c-48f3-881b-6b538df29258 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:33.079686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db14eae8-490c-48f3-881b-6b538df29258 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:33.080129 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db14eae8-490c-48f3-881b-6b538df29258 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:33.080913 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db14eae8-490c-48f3-881b-6b538df29258 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:33.081342 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db14eae8-490c-48f3-881b-6b538df29258 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:33.147389 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-d2207f13-df96-44e1-be5b-ebabe33096f9 req-c651b39b-b7d2-4402-96f5-d9ad5c97ac0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d182cbe3-dff4-482c-a901-f084fc7b0077", "name": "network-vif-plugged", "status": "completed", "tag": "7f871a00-9630-48c9-845a-ddb06fb9a2df"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:33.157879 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-d2207f13-df96-44e1-be5b-ebabe33096f9 req-c651b39b-b7d2-4402-96f5-d9ad5c97ac0e service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:33.158439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-d2207f13-df96-44e1-be5b-ebabe33096f9 req-c651b39b-b7d2-4402-96f5-d9ad5c97ac0e service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:33.169324 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-d2207f13-df96-44e1-be5b-ebabe33096f9 req-c651b39b-b7d2-4402-96f5-d9ad5c97ac0e service nova] Creating event network-vif-plugged:7f871a00-9630-48c9-845a-ddb06fb9a2df for instance d182cbe3-dff4-482c-a901-f084fc7b0077 on hv-cinder-85104 Jul 26 16:38:33.174345 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-d2207f13-df96-44e1-be5b-ebabe33096f9 req-c651b39b-b7d2-4402-96f5-d9ad5c97ac0e service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030618 Jul 26 16:38:33.174936 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 300/614] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:38:33.219762 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-db14eae8-490c-48f3-881b-6b538df29258 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:33.229528 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-db14eae8-490c-48f3-881b-6b538df29258 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:33.231031 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-db14eae8-490c-48f3-881b-6b538df29258 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:33.232871 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-db14eae8-490c-48f3-881b-6b538df29258 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.163978 Jul 26 16:38:33.233466 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 315/615] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:33 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:33.279790 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-177cc717-7b48-4c64-8d20-5e8780377ba5 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:33.280632 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-177cc717-7b48-4c64-8d20-5e8780377ba5 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:33.287690 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-177cc717-7b48-4c64-8d20-5e8780377ba5 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:33.288137 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-177cc717-7b48-4c64-8d20-5e8780377ba5 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:33.288923 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-177cc717-7b48-4c64-8d20-5e8780377ba5 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:33.289940 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-177cc717-7b48-4c64-8d20-5e8780377ba5 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:33.423289 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-177cc717-7b48-4c64-8d20-5e8780377ba5 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:33.430797 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-177cc717-7b48-4c64-8d20-5e8780377ba5 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.155169 Jul 26 16:38:33.431356 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 301/616] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:33 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:34.256816 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9aff444f-23a8-4f96-91a8-24e915b4e269 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:34.257346 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9aff444f-23a8-4f96-91a8-24e915b4e269 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:34.263755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9aff444f-23a8-4f96-91a8-24e915b4e269 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:34.264208 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9aff444f-23a8-4f96-91a8-24e915b4e269 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:34.264997 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9aff444f-23a8-4f96-91a8-24e915b4e269 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:34.265434 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9aff444f-23a8-4f96-91a8-24e915b4e269 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:34.394415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9aff444f-23a8-4f96-91a8-24e915b4e269 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:34.402937 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9aff444f-23a8-4f96-91a8-24e915b4e269 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:34.404464 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9aff444f-23a8-4f96-91a8-24e915b4e269 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:34.405612 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9aff444f-23a8-4f96-91a8-24e915b4e269 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.152871 Jul 26 16:38:34.406166 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 316/617] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:34 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:34.452157 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-843a9e9f-cbb6-4ef8-a7f4-34ff34022609 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:34.452814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-843a9e9f-cbb6-4ef8-a7f4-34ff34022609 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:34.459179 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-843a9e9f-cbb6-4ef8-a7f4-34ff34022609 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:34.462140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-843a9e9f-cbb6-4ef8-a7f4-34ff34022609 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:34.462140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-843a9e9f-cbb6-4ef8-a7f4-34ff34022609 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:34.462140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-843a9e9f-cbb6-4ef8-a7f4-34ff34022609 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:34.600868 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-843a9e9f-cbb6-4ef8-a7f4-34ff34022609 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:34.608295 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-843a9e9f-cbb6-4ef8-a7f4-34ff34022609 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.159966 Jul 26 16:38:34.608888 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 302/618] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:34 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:35.429090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b8f0b330-6e34-4cbd-a769-c8a0c8386785 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:35.429696 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b8f0b330-6e34-4cbd-a769-c8a0c8386785 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:35.436149 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b8f0b330-6e34-4cbd-a769-c8a0c8386785 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:35.436624 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b8f0b330-6e34-4cbd-a769-c8a0c8386785 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:35.437381 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b8f0b330-6e34-4cbd-a769-c8a0c8386785 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:35.437814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b8f0b330-6e34-4cbd-a769-c8a0c8386785 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:35.569416 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b8f0b330-6e34-4cbd-a769-c8a0c8386785 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:35.577843 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b8f0b330-6e34-4cbd-a769-c8a0c8386785 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:35.579865 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b8f0b330-6e34-4cbd-a769-c8a0c8386785 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:35.581033 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b8f0b330-6e34-4cbd-a769-c8a0c8386785 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.155810 Jul 26 16:38:35.581585 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 317/619] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:35 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:35.631077 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-932ebacc-b679-456a-a95b-e81df163b0d2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:35.631676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-932ebacc-b679-456a-a95b-e81df163b0d2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:35.644594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-932ebacc-b679-456a-a95b-e81df163b0d2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:35.644594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-932ebacc-b679-456a-a95b-e81df163b0d2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:35.644594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-932ebacc-b679-456a-a95b-e81df163b0d2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:35.644594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-932ebacc-b679-456a-a95b-e81df163b0d2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:35.765724 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-932ebacc-b679-456a-a95b-e81df163b0d2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:35.773724 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-932ebacc-b679-456a-a95b-e81df163b0d2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.146469 Jul 26 16:38:35.774547 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 303/620] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:35 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:36.604757 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1578f1e7-5ad1-4aa5-bcb3-3e5b7ef3f222 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:36.605358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1578f1e7-5ad1-4aa5-bcb3-3e5b7ef3f222 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:36.612207 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1578f1e7-5ad1-4aa5-bcb3-3e5b7ef3f222 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:36.628495 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1578f1e7-5ad1-4aa5-bcb3-3e5b7ef3f222 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:36.628495 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1578f1e7-5ad1-4aa5-bcb3-3e5b7ef3f222 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:36.628495 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1578f1e7-5ad1-4aa5-bcb3-3e5b7ef3f222 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:36.746908 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1578f1e7-5ad1-4aa5-bcb3-3e5b7ef3f222 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:36.755312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1578f1e7-5ad1-4aa5-bcb3-3e5b7ef3f222 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:36.756833 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1578f1e7-5ad1-4aa5-bcb3-3e5b7ef3f222 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:36.757974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1578f1e7-5ad1-4aa5-bcb3-3e5b7ef3f222 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1811 microversion: 2.20 time: 0.157190 Jul 26 16:38:36.758618 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 318/621] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:36 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:36.795135 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0b7f9e6a-bbc5-4f3b-9dd3-65eeaf209a8b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:36.795849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0b7f9e6a-bbc5-4f3b-9dd3-65eeaf209a8b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:36.803086 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0b7f9e6a-bbc5-4f3b-9dd3-65eeaf209a8b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:36.803613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0b7f9e6a-bbc5-4f3b-9dd3-65eeaf209a8b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:36.804473 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0b7f9e6a-bbc5-4f3b-9dd3-65eeaf209a8b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:36.804987 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0b7f9e6a-bbc5-4f3b-9dd3-65eeaf209a8b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:36.880677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-34f16041-79ac-41d4-9e9e-90f549d9bc0a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:36.881661 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-34f16041-79ac-41d4-9e9e-90f549d9bc0a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:36.888348 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34f16041-79ac-41d4-9e9e-90f549d9bc0a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:36.888348 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34f16041-79ac-41d4-9e9e-90f549d9bc0a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:36.889144 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34f16041-79ac-41d4-9e9e-90f549d9bc0a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:36.889619 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34f16041-79ac-41d4-9e9e-90f549d9bc0a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:36.916524 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-34f16041-79ac-41d4-9e9e-90f549d9bc0a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d/ips" status: 200 len: 150 microversion: 2.1 time: 0.090896 Jul 26 16:38:36.917390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 319/622] 10.222.0.144 () {58 vars in 1253 bytes} [Tue Jul 26 16:38:36 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:38:36.929003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-93e27227-8b91-4de0-9e1f-358373020fb5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37a87f89-6610-406c-b02c-2d4164d51538"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:36.931680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-93e27227-8b91-4de0-9e1f-358373020fb5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:36.937925 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-93e27227-8b91-4de0-9e1f-358373020fb5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:36.938619 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-93e27227-8b91-4de0-9e1f-358373020fb5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:36.939395 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-93e27227-8b91-4de0-9e1f-358373020fb5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:36.939831 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-93e27227-8b91-4de0-9e1f-358373020fb5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:36.950178 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0b7f9e6a-bbc5-4f3b-9dd3-65eeaf209a8b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:36.960264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0b7f9e6a-bbc5-4f3b-9dd3-65eeaf209a8b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.168164 Jul 26 16:38:36.961496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 304/623] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:36 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:37.025207 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-93e27227-8b91-4de0-9e1f-358373020fb5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Invalid volume: volume 37a87f89-6610-406c-b02c-2d4164d51538 is already attached to instances: 10c1c021-13e8-4f87-bcff-9bac39392b1e Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-93e27227-8b91-4de0-9e1f-358373020fb5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: POST /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d/os-volume_attachments HTTP/1.1 Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 74 Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:38:37.027002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {"volumeAttachment": {"volumeId": "37a87f89-6610-406c-b02c-2d4164d51538"}} Jul 26 16:38:37.028605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Invalid volume: volume 37a87f89-6610-406c-b02c-2d4164d51538 is already attached to instances: 10c1c021-13e8-4f87-bcff-9bac39392b1e Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'server_id': '178c5e10-8273-4f85-8802-ab643a1c9b6d', 'body': {'volumeAttachment': {'volumeId': '37a87f89-6610-406c-b02c-2d4164d51538'}}} Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 37a87f89-6610-406c-b02c-2d4164d51538 is already attached to instances: 10c1c021-13e8-4f87-bcff-9bac39392b1e Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:37.029411 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 37a87f89-6610-406c-b02c-2d4164d51538 is already attached to instances: 10c1c021-13e8-4f87-bcff-9bac39392b1e Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:37.030546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:38:37.031783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:38:37.031783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:38:37.031783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:38:37.031783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 37a87f89-6610-406c-b02c-2d4164d51538 is already attached to instances: 10c1c021-13e8-4f87-bcff-9bac39392b1e Jul 26 16:38:37.031783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:37.031783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-93e27227-8b91-4de0-9e1f-358373020fb5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 400 to user: Invalid volume: volume 37a87f89-6610-406c-b02c-2d4164d51538 is already attached to instances: 10c1c021-13e8-4f87-bcff-9bac39392b1e {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:38:37.031783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-93e27227-8b91-4de0-9e1f-358373020fb5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103436 Jul 26 16:38:37.031783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 320/624] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:38:36 2022] POST /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 26 16:38:37.037255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fc4d9229-63ab-475b-b56d-affdf91ef92b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:37.037740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fc4d9229-63ab-475b-b56d-affdf91ef92b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:37.043885 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc4d9229-63ab-475b-b56d-affdf91ef92b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:37.044325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc4d9229-63ab-475b-b56d-affdf91ef92b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:37.045113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc4d9229-63ab-475b-b56d-affdf91ef92b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:37.045544 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc4d9229-63ab-475b-b56d-affdf91ef92b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:37.070888 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fc4d9229-63ab-475b-b56d-affdf91ef92b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:38:37.418008 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fc4d9229-63ab-475b-b56d-affdf91ef92b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 204 len: 0 microversion: 2.1 time: 0.384077 Jul 26 16:38:37.418602 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 305/625] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:38:37 2022] DELETE /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:38:37.427379 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ae3e19ab-660e-4320-8237-621d1b16fb43 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:37.429859 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ae3e19ab-660e-4320-8237-621d1b16fb43 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:37.434100 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ae3e19ab-660e-4320-8237-621d1b16fb43 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:37.434636 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ae3e19ab-660e-4320-8237-621d1b16fb43 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:37.435403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ae3e19ab-660e-4320-8237-621d1b16fb43 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:37.435825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ae3e19ab-660e-4320-8237-621d1b16fb43 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:37.580257 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ae3e19ab-660e-4320-8237-621d1b16fb43 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:37.590822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ae3e19ab-660e-4320-8237-621d1b16fb43 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1687 microversion: 2.1 time: 0.167177 Jul 26 16:38:37.591381 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 321/626] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:37 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:37.782572 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-572753d7-19d6-4a00-9173-e08478efe870 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:37.783167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-572753d7-19d6-4a00-9173-e08478efe870 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:37.789300 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-572753d7-19d6-4a00-9173-e08478efe870 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:37.789740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-572753d7-19d6-4a00-9173-e08478efe870 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:37.790500 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-572753d7-19d6-4a00-9173-e08478efe870 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:37.790905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-572753d7-19d6-4a00-9173-e08478efe870 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:37.922907 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-572753d7-19d6-4a00-9173-e08478efe870 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:37.931216 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-572753d7-19d6-4a00-9173-e08478efe870 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:37.932740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-572753d7-19d6-4a00-9173-e08478efe870 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:37.933876 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-572753d7-19d6-4a00-9173-e08478efe870 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1798 microversion: 2.20 time: 0.156161 Jul 26 16:38:37.934432 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 306/627] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:38:37 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1798 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:38:37.982856 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-feb0cf61-084e-4219-bb7d-d542e4f72086 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:37.983467 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-feb0cf61-084e-4219-bb7d-d542e4f72086 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:37.990054 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-feb0cf61-084e-4219-bb7d-d542e4f72086 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:37.990497 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-feb0cf61-084e-4219-bb7d-d542e4f72086 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:37.991256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-feb0cf61-084e-4219-bb7d-d542e4f72086 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:37.991691 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-feb0cf61-084e-4219-bb7d-d542e4f72086 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:38.117191 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-feb0cf61-084e-4219-bb7d-d542e4f72086 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:38.124618 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-feb0cf61-084e-4219-bb7d-d542e4f72086 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.145600 Jul 26 16:38:38.125177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 322/628] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:37 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:38.613626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-32191c4d-4dc9-49a0-89dd-417f7cd4fbff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:38.614236 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-32191c4d-4dc9-49a0-89dd-417f7cd4fbff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:38.620330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32191c4d-4dc9-49a0-89dd-417f7cd4fbff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:38.620817 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32191c4d-4dc9-49a0-89dd-417f7cd4fbff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:38.621572 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32191c4d-4dc9-49a0-89dd-417f7cd4fbff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:38.622007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32191c4d-4dc9-49a0-89dd-417f7cd4fbff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:38.750069 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-32191c4d-4dc9-49a0-89dd-417f7cd4fbff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:38.754202 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:38:38.758432 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-32191c4d-4dc9-49a0-89dd-417f7cd4fbff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1687 microversion: 2.1 time: 0.149323 Jul 26 16:38:38.758985 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 307/629] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:38 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:39.147655 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-78d9dfdd-b355-483f-8853-3fa4a21a69c4 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:39.148268 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-78d9dfdd-b355-483f-8853-3fa4a21a69c4 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:39.155058 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-78d9dfdd-b355-483f-8853-3fa4a21a69c4 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:39.155510 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-78d9dfdd-b355-483f-8853-3fa4a21a69c4 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:39.156270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-78d9dfdd-b355-483f-8853-3fa4a21a69c4 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:39.156736 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-78d9dfdd-b355-483f-8853-3fa4a21a69c4 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:39.160719 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:38:39.298304 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-78d9dfdd-b355-483f-8853-3fa4a21a69c4 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:39.306492 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-78d9dfdd-b355-483f-8853-3fa4a21a69c4 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.162826 Jul 26 16:38:39.307047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 323/630] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:39 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:39.779714 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e395d6c6-137e-4435-8e8c-eb4699920d7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:39.781029 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e395d6c6-137e-4435-8e8c-eb4699920d7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:39.788943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e395d6c6-137e-4435-8e8c-eb4699920d7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:39.789393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e395d6c6-137e-4435-8e8c-eb4699920d7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:39.790161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e395d6c6-137e-4435-8e8c-eb4699920d7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:39.790593 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e395d6c6-137e-4435-8e8c-eb4699920d7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:40.055845 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e395d6c6-137e-4435-8e8c-eb4699920d7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:40.063360 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e395d6c6-137e-4435-8e8c-eb4699920d7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1687 microversion: 2.1 time: 0.287669 Jul 26 16:38:40.064118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 308/631] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:39 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1687 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:40.335733 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8da2a695-a601-4dad-9833-41fe10998421 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:40.336337 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8da2a695-a601-4dad-9833-41fe10998421 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:40.343397 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8da2a695-a601-4dad-9833-41fe10998421 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:40.343838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8da2a695-a601-4dad-9833-41fe10998421 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:40.346830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8da2a695-a601-4dad-9833-41fe10998421 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:40.346830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8da2a695-a601-4dad-9833-41fe10998421 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:40.490414 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8da2a695-a601-4dad-9833-41fe10998421 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:40.499760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8da2a695-a601-4dad-9833-41fe10998421 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1680 microversion: 2.1 time: 0.171955 Jul 26 16:38:40.500339 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 324/632] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:40 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:41.008313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-8eef1d32-d6cc-4789-ade7-b23293e1859d req-b6d45b71-ccc4-4079-92e0-237fd1f04c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178c5e10-8273-4f85-8802-ab643a1c9b6d", "name": "network-vif-deleted", "tag": "1b0b636e-41d7-4e36-912a-bf842602d0ee"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:41.018064 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-8eef1d32-d6cc-4789-ade7-b23293e1859d req-b6d45b71-ccc4-4079-92e0-237fd1f04c36 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:41.018499 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-8eef1d32-d6cc-4789-ade7-b23293e1859d req-b6d45b71-ccc4-4079-92e0-237fd1f04c36 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:41.030352 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-8eef1d32-d6cc-4789-ade7-b23293e1859d req-b6d45b71-ccc4-4079-92e0-237fd1f04c36 service nova] Creating event network-vif-deleted:1b0b636e-41d7-4e36-912a-bf842602d0ee for instance 178c5e10-8273-4f85-8802-ab643a1c9b6d on hv-cinder-85104 Jul 26 16:38:41.035235 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-8eef1d32-d6cc-4789-ade7-b23293e1859d req-b6d45b71-ccc4-4079-92e0-237fd1f04c36 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089950 Jul 26 16:38:41.035817 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 309/633] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:38:41.084883 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-32594d4b-9111-4716-bc07-9f9642433b4b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:41.085646 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-32594d4b-9111-4716-bc07-9f9642433b4b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:41.091721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32594d4b-9111-4716-bc07-9f9642433b4b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:41.092300 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32594d4b-9111-4716-bc07-9f9642433b4b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:41.093204 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32594d4b-9111-4716-bc07-9f9642433b4b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:41.093738 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32594d4b-9111-4716-bc07-9f9642433b4b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:41.157033 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-32594d4b-9111-4716-bc07-9f9642433b4b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:41.169290 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-32594d4b-9111-4716-bc07-9f9642433b4b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1619 microversion: 2.1 time: 0.088367 Jul 26 16:38:41.169880 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 325/634] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:41 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1619 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:41.523627 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e2d93056-0b86-46b6-afa2-26cc2a075e4e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:41.529804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e2d93056-0b86-46b6-afa2-26cc2a075e4e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:41.531057 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e2d93056-0b86-46b6-afa2-26cc2a075e4e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:41.531519 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e2d93056-0b86-46b6-afa2-26cc2a075e4e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:41.532403 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e2d93056-0b86-46b6-afa2-26cc2a075e4e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:41.532838 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e2d93056-0b86-46b6-afa2-26cc2a075e4e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:41.675253 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e2d93056-0b86-46b6-afa2-26cc2a075e4e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:41.683456 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e2d93056-0b86-46b6-afa2-26cc2a075e4e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1657 microversion: 2.1 time: 0.164065 Jul 26 16:38:41.684030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 310/635] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:41 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1657 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:41.704504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-299ab98a-500c-497c-9d07-f384abdc968e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:41.711976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-299ab98a-500c-497c-9d07-f384abdc968e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:41.712797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-299ab98a-500c-497c-9d07-f384abdc968e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:41.740890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-299ab98a-500c-497c-9d07-f384abdc968e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Going to try to start instance {{(pid=124821) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 26 16:38:41.912685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-299ab98a-500c-497c-9d07-f384abdc968e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/action" status: 202 len: 0 microversion: 2.1 time: 0.212352 Jul 26 16:38:41.916368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 326/636] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:38:41 2022] POST /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:38:41.921528 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2d876894-22d1-46d8-be11-e461b76dfd3a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:41.922129 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2d876894-22d1-46d8-be11-e461b76dfd3a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:41.928814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d876894-22d1-46d8-be11-e461b76dfd3a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:41.929260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d876894-22d1-46d8-be11-e461b76dfd3a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:41.930040 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d876894-22d1-46d8-be11-e461b76dfd3a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:41.931779 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d876894-22d1-46d8-be11-e461b76dfd3a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:42.073174 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2d876894-22d1-46d8-be11-e461b76dfd3a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:42.084594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2d876894-22d1-46d8-be11-e461b76dfd3a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1666 microversion: 2.1 time: 0.166741 Jul 26 16:38:42.085178 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 311/637] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:41 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:42.194185 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:42.194890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:42.204430 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:42.205110 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:42.206074 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:42.206660 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:42.241804 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:42.242257 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:42.242708 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lazy-loading 'fault' on Instance uuid 178c5e10-8273-4f85-8802-ab643a1c9b6d {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:38:42.286353 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:42.294343 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1c6b0e34-8432-492a-8ee7-dc9f4fe172e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 200 len: 1336 microversion: 2.1 time: 0.104226 Jul 26 16:38:42.294917 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 327/638] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:42 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 1336 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:43.106118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7f661758-9cee-44cf-a3c5-ba85f240a65b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:43.106715 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7f661758-9cee-44cf-a3c5-ba85f240a65b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:43.113678 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f661758-9cee-44cf-a3c5-ba85f240a65b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:43.114122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f661758-9cee-44cf-a3c5-ba85f240a65b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:43.114876 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f661758-9cee-44cf-a3c5-ba85f240a65b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:43.115309 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f661758-9cee-44cf-a3c5-ba85f240a65b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:43.241837 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7f661758-9cee-44cf-a3c5-ba85f240a65b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:43.249281 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7f661758-9cee-44cf-a3c5-ba85f240a65b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1666 microversion: 2.1 time: 0.146973 Jul 26 16:38:43.249845 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 312/639] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:43 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1666 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:43.315805 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3708c482-46df-47a7-9a5f-8ea029db93be tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:43.316429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3708c482-46df-47a7-9a5f-8ea029db93be tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:43.322851 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3708c482-46df-47a7-9a5f-8ea029db93be tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:43.325904 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3708c482-46df-47a7-9a5f-8ea029db93be tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:43.325904 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3708c482-46df-47a7-9a5f-8ea029db93be tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:43.325904 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3708c482-46df-47a7-9a5f-8ea029db93be tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:43.341843 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-3708c482-46df-47a7-9a5f-8ea029db93be tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3708c482-46df-47a7-9a5f-8ea029db93be tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d HTTP/1.1 Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:38:43.343459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:38:43.346034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '178c5e10-8273-4f85-8802-ab643a1c9b6d'} Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:38:43.347795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:38:43.350326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:43.352456 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3708c482-46df-47a7-9a5f-8ea029db93be tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:38:43.352456 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3708c482-46df-47a7-9a5f-8ea029db93be tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 404 len: 111 microversion: 2.1 time: 0.033560 Jul 26 16:38:43.352456 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 328/640] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:43 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:38:43.356102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0360ee2a-3ee7-4a48-a104-4bee405c44c9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '.version_select at 0x7f4b6c264160>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:43.478440 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0360ee2a-3ee7-4a48-a104-4bee405c44c9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020052871" status: 202 len: 0 microversion: 2.1 time: 0.126074 Jul 26 16:38:43.478941 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 313/641] 10.222.0.144 () {58 vars in 1226 bytes} [Tue Jul 26 16:38:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020052871 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 16:38:44.270614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1f181a70-06a2-4d4f-a1ff-09435ec69e97 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:44.271223 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1f181a70-06a2-4d4f-a1ff-09435ec69e97 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:44.277540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f181a70-06a2-4d4f-a1ff-09435ec69e97 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:44.277990 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f181a70-06a2-4d4f-a1ff-09435ec69e97 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:44.278747 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f181a70-06a2-4d4f-a1ff-09435ec69e97 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:44.279180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f181a70-06a2-4d4f-a1ff-09435ec69e97 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:44.281625 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b417c93b-afee-4db2-b44b-ba95838ca590 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:44.282962 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b417c93b-afee-4db2-b44b-ba95838ca590 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:44.289567 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b417c93b-afee-4db2-b44b-ba95838ca590 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:44.290024 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b417c93b-afee-4db2-b44b-ba95838ca590 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:44.290849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b417c93b-afee-4db2-b44b-ba95838ca590 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:44.291289 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b417c93b-afee-4db2-b44b-ba95838ca590 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:44.369648 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-b417c93b-afee-4db2-b44b-ba95838ca590 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lazy-loading 'services' on Instance uuid 10c1c021-13e8-4f87-bcff-9bac39392b1e {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:38:44.412747 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1f181a70-06a2-4d4f-a1ff-09435ec69e97 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:44.420337 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1f181a70-06a2-4d4f-a1ff-09435ec69e97 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1670 microversion: 2.1 time: 0.154100 Jul 26 16:38:44.420930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 329/642] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:44 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:44.601865 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b417c93b-afee-4db2-b44b-ba95838ca590 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-volume_attachments/37a87f89-6610-406c-b02c-2d4164d51538" status: 202 len: 0 microversion: 2.1 time: 0.324563 Jul 26 16:38:44.602463 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 314/643] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:38:44 2022] DELETE /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-volume_attachments/37a87f89-6610-406c-b02c-2d4164d51538 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 16:38:44.612519 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-88b51c88-1db5-4767-ad6a-72a3a8932714 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:44.614885 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-88b51c88-1db5-4767-ad6a-72a3a8932714 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:44.620940 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-88b51c88-1db5-4767-ad6a-72a3a8932714 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:44.621394 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-88b51c88-1db5-4767-ad6a-72a3a8932714 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:44.622165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-88b51c88-1db5-4767-ad6a-72a3a8932714 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:44.622600 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-88b51c88-1db5-4767-ad6a-72a3a8932714 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:44.652059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-88b51c88-1db5-4767-ad6a-72a3a8932714 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045028 Jul 26 16:38:44.652569 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 330/644] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:38:44 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:38:45.664370 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-11e397ef-0892-402c-9971-e8630d35f1fc tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:45.666698 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-11e397ef-0892-402c-9971-e8630d35f1fc tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:45.673956 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11e397ef-0892-402c-9971-e8630d35f1fc tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:45.674405 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11e397ef-0892-402c-9971-e8630d35f1fc tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:45.675167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11e397ef-0892-402c-9971-e8630d35f1fc tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:45.675604 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11e397ef-0892-402c-9971-e8630d35f1fc tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:45.710568 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-11e397ef-0892-402c-9971-e8630d35f1fc tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050272 Jul 26 16:38:45.711372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 315/645] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:38:45 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:38:46.725018 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0d961f6d-b67f-466d-ab23-03f97c07beff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:46.728331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0d961f6d-b67f-466d-ab23-03f97c07beff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:46.737275 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0d961f6d-b67f-466d-ab23-03f97c07beff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:46.737744 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0d961f6d-b67f-466d-ab23-03f97c07beff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:46.738676 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0d961f6d-b67f-466d-ab23-03f97c07beff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:46.739201 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0d961f6d-b67f-466d-ab23-03f97c07beff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:46.771134 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0d961f6d-b67f-466d-ab23-03f97c07beff tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051733 Jul 26 16:38:46.771605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 331/646] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:38:46 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 16:38:46.834126 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-595f386d-a299-400e-80e2-37d7560fb49b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:46.834645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-595f386d-a299-400e-80e2-37d7560fb49b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:46.841100 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-595f386d-a299-400e-80e2-37d7560fb49b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:46.841544 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-595f386d-a299-400e-80e2-37d7560fb49b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:46.842294 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-595f386d-a299-400e-80e2-37d7560fb49b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:46.842724 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-595f386d-a299-400e-80e2-37d7560fb49b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:46.867504 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-595f386d-a299-400e-80e2-37d7560fb49b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:38:47.174182 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-595f386d-a299-400e-80e2-37d7560fb49b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 204 len: 0 microversion: 2.1 time: 0.343568 Jul 26 16:38:47.174768 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 316/647] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:38:46 2022] DELETE /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:38:47.184046 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e44f018e-8997-497f-935c-9cf878c7448a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:47.184688 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e44f018e-8997-497f-935c-9cf878c7448a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:47.190789 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e44f018e-8997-497f-935c-9cf878c7448a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:47.191243 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e44f018e-8997-497f-935c-9cf878c7448a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:47.192008 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e44f018e-8997-497f-935c-9cf878c7448a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:47.192477 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e44f018e-8997-497f-935c-9cf878c7448a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:47.320980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e44f018e-8997-497f-935c-9cf878c7448a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:47.328415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e44f018e-8997-497f-935c-9cf878c7448a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1685 microversion: 2.1 time: 0.149357 Jul 26 16:38:47.329511 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 332/648] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:47 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:48.351342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-054f3e6b-ee61-497a-bb61-00932a14db7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:48.352029 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-054f3e6b-ee61-497a-bb61-00932a14db7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:48.358536 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-054f3e6b-ee61-497a-bb61-00932a14db7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:48.358978 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-054f3e6b-ee61-497a-bb61-00932a14db7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:48.359730 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-054f3e6b-ee61-497a-bb61-00932a14db7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:48.360177 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-054f3e6b-ee61-497a-bb61-00932a14db7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:48.564256 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-054f3e6b-ee61-497a-bb61-00932a14db7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:48.571882 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-054f3e6b-ee61-497a-bb61-00932a14db7c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1685 microversion: 2.1 time: 0.224760 Jul 26 16:38:48.572462 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 317/649] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:48 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1685 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:49.328077 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-5587e3c1-78e6-47ab-9da7-c6e38ffe49cd req-be58e66d-e0ad-418f-9212-7a0ab22a7a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10c1c021-13e8-4f87-bcff-9bac39392b1e", "name": "network-vif-deleted", "tag": "a5df5a50-4c77-4fe7-abd3-ff061e50b15d"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:49.333906 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=58 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:38:49.339406 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-5587e3c1-78e6-47ab-9da7-c6e38ffe49cd req-be58e66d-e0ad-418f-9212-7a0ab22a7a71 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:49.342260 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-5587e3c1-78e6-47ab-9da7-c6e38ffe49cd req-be58e66d-e0ad-418f-9212-7a0ab22a7a71 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:49.351837 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-5587e3c1-78e6-47ab-9da7-c6e38ffe49cd req-be58e66d-e0ad-418f-9212-7a0ab22a7a71 service nova] Creating event network-vif-deleted:a5df5a50-4c77-4fe7-abd3-ff061e50b15d for instance 10c1c021-13e8-4f87-bcff-9bac39392b1e on hv-cinder-85104 Jul 26 16:38:49.357869 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-5587e3c1-78e6-47ab-9da7-c6e38ffe49cd req-be58e66d-e0ad-418f-9212-7a0ab22a7a71 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033081 Jul 26 16:38:49.358700 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 333/650] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:38:49.593684 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6350aca5-59c4-44ae-987d-39907e488996 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:49.594867 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6350aca5-59c4-44ae-987d-39907e488996 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:49.601330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6350aca5-59c4-44ae-987d-39907e488996 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:49.603905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6350aca5-59c4-44ae-987d-39907e488996 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:49.603905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6350aca5-59c4-44ae-987d-39907e488996 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:49.603905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6350aca5-59c4-44ae-987d-39907e488996 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:49.666107 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6350aca5-59c4-44ae-987d-39907e488996 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:49.674997 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6350aca5-59c4-44ae-987d-39907e488996 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 200 len: 1330 microversion: 2.1 time: 0.085076 Jul 26 16:38:49.688028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 318/651] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:49 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:50.696648 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-20c23672-011f-4557-9e24-51a26275b271 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:50.697597 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-20c23672-011f-4557-9e24-51a26275b271 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:50.707620 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-20c23672-011f-4557-9e24-51a26275b271 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:50.708426 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-20c23672-011f-4557-9e24-51a26275b271 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:50.709249 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-20c23672-011f-4557-9e24-51a26275b271 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:50.709684 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-20c23672-011f-4557-9e24-51a26275b271 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:50.723163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-20c23672-011f-4557-9e24-51a26275b271 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-20c23672-011f-4557-9e24-51a26275b271 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e HTTP/1.1 Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:38:50.724810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:38:50.726367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '10c1c021-13e8-4f87-bcff-9bac39392b1e'} Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:38:50.727202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:38:50.728587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:38:50.729875 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-20c23672-011f-4557-9e24-51a26275b271 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:38:50.729875 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-20c23672-011f-4557-9e24-51a26275b271 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 404 len: 111 microversion: 2.1 time: 0.034412 Jul 26 16:38:50.729875 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 334/652] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:50 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:38:50.735697 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d1535fff-9ba2-4c37-be64-74cb6c1ed852 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '.version_select at 0x7f4b6c06a310>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:50.743564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:38:50.803673 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d1535fff-9ba2-4c37-be64-74cb6c1ed852 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902753241" status: 202 len: 0 microversion: 2.1 time: 0.072343 Jul 26 16:38:50.804246 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 319/653] 10.222.0.144 () {58 vars in 1226 bytes} [Tue Jul 26 16:38:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1902753241 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:38:51.552842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6ea4558e-b4bc-4eea-8896-4f2ab1daebad tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: .version_select at 0x7f4b6c2025e0>, body: {"keypair": {"name": "tempest-keypair-1900774415", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhqkYpbjEniq5rZd9AF/+ve/dxv2KrjaxiBmOTemMSLGej5ireMj2V8BIX8lTUBzYw6o7M2Lagtle7he2BXp+oH/aEE9E5U43JkW7Q8HzVJvuJKbwmp9WfziwwxRlE8+g=="}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:51.567945 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-6ea4558e-b4bc-4eea-8896-4f2ab1daebad tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for project 8bb1d794693b410d8c759796d5e20281. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:38:51.571814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-6ea4558e-b4bc-4eea-8896-4f2ab1daebad tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for user 4c6fffcc3c0d4c49848fa6c2f6b90130 and project 8bb1d794693b410d8c759796d5e20281. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:38:51.584907 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6ea4558e-b4bc-4eea-8896-4f2ab1daebad tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [5015cc5d-607d-455b-93b5-c25b7e19391a] AMQP server on 10.222.0.144:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 26 16:38:52.591985 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO oslo.messaging._drivers.impl_rabbit [None req-6ea4558e-b4bc-4eea-8896-4f2ab1daebad tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [5015cc5d-607d-455b-93b5-c25b7e19391a] Reconnected to AMQP server on 10.222.0.144:5672 via [amqp] client with port 60548. Jul 26 16:38:52.678510 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6ea4558e-b4bc-4eea-8896-4f2ab1daebad tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.129587 Jul 26 16:38:52.679301 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 335/654] 10.222.0.144 () {60 vars in 1164 bytes} [Tue Jul 26 16:38:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:38:54.794596 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1332938928", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fec62f0-42f9-4a76-8f36-14730e310aa9"}], "security_groups": [{"name": "tempest-securitygroup--143539594"}], "key_name": "tempest-keypair-1900774415", "user_data": "}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:38:54.895615 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.network.neutron [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] validate_networks() for [('7fec62f0-42f9-4a76-8f36-14730e310aa9', None, None, None, None, None)] {{(pid=124820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:38:55.301591 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Flavor limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:38:55.302090 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Image limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:38:55.302582 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Flavor pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:38:55.303030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Image pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:38:55.303439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:38:55.312321 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:55.312804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:55.313609 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:55.314081 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:55.331004 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for project 8bb1d794693b410d8c759796d5e20281. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:38:55.334991 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for user 4c6fffcc3c0d4c49848fa6c2f6b90130 and project 8bb1d794693b410d8c759796d5e20281. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:38:55.346674 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Going to run 1 instances... {{(pid=124820) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:38:55.349033 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:38:55.505715 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f51f0110-7b75-423a-827e-f26317b62cb0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.715855 Jul 26 16:38:55.506988 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 320/655] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:38:54 2022] POST /compute/v2.1/servers => generated 403 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:38:55.519365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0c973fe9-cb1b-4eda-88b8-a26e74fc366f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:55.520691 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0c973fe9-cb1b-4eda-88b8-a26e74fc366f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:55.575100 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0c973fe9-cb1b-4eda-88b8-a26e74fc366f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:55.582319 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0c973fe9-cb1b-4eda-88b8-a26e74fc366f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1246 microversion: 2.1 time: 0.067803 Jul 26 16:38:55.582873 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 336/656] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:55 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1246 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:56.603217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-602fc8c7-59fc-4db1-87e5-939059b713b7 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:56.603827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-602fc8c7-59fc-4db1-87e5-939059b713b7 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:56.655367 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-602fc8c7-59fc-4db1-87e5-939059b713b7 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:56.662571 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-602fc8c7-59fc-4db1-87e5-939059b713b7 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1246 microversion: 2.1 time: 0.063771 Jul 26 16:38:56.663128 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 321/657] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:56 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1246 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:57.683552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cfc90158-ede9-4d3f-b5c2-5180f0965e3c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:57.684161 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-cfc90158-ede9-4d3f-b5c2-5180f0965e3c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:57.736299 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-cfc90158-ede9-4d3f-b5c2-5180f0965e3c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:57.743825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-cfc90158-ede9-4d3f-b5c2-5180f0965e3c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1246 microversion: 2.1 time: 0.064094 Jul 26 16:38:57.744329 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 337/658] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:57 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1246 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:58.764361 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9000a96d-a672-4fca-8058-2366b545e722 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:58.764914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9000a96d-a672-4fca-8058-2366b545e722 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:58.820924 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9000a96d-a672-4fca-8058-2366b545e722 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:58.827460 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9000a96d-a672-4fca-8058-2366b545e722 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1246 microversion: 2.1 time: 0.067015 Jul 26 16:38:58.828135 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 322/659] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:58 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1246 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:38:59.848536 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e36ee94f-9d8e-40d3-9b04-543cf22a3d83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:38:59.849149 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e36ee94f-9d8e-40d3-9b04-543cf22a3d83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:38:59.855346 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e36ee94f-9d8e-40d3-9b04-543cf22a3d83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:59.855794 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e36ee94f-9d8e-40d3-9b04-543cf22a3d83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:59.856580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e36ee94f-9d8e-40d3-9b04-543cf22a3d83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:38:59.857019 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e36ee94f-9d8e-40d3-9b04-543cf22a3d83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:38:59.921995 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e36ee94f-9d8e-40d3-9b04-543cf22a3d83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:38:59.929862 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e36ee94f-9d8e-40d3-9b04-543cf22a3d83 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1250 microversion: 2.1 time: 0.085296 Jul 26 16:38:59.930417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 338/660] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:38:59 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:00.950933 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-436214db-c6fa-426a-8717-c7108df54115 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:00.951537 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-436214db-c6fa-426a-8717-c7108df54115 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:00.959481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-436214db-c6fa-426a-8717-c7108df54115 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:00.959929 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-436214db-c6fa-426a-8717-c7108df54115 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:00.960867 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-436214db-c6fa-426a-8717-c7108df54115 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:00.961303 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-436214db-c6fa-426a-8717-c7108df54115 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:01.025216 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-436214db-c6fa-426a-8717-c7108df54115 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:01.033709 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-436214db-c6fa-426a-8717-c7108df54115 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1242 microversion: 2.1 time: 0.086821 Jul 26 16:39:01.034279 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 323/661] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:00 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1242 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:02.054974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-225a090f-ed85-4695-b4c0-014049a006b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:02.055552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-225a090f-ed85-4695-b4c0-014049a006b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:02.062082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-225a090f-ed85-4695-b4c0-014049a006b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:02.062524 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-225a090f-ed85-4695-b4c0-014049a006b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:02.063282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-225a090f-ed85-4695-b4c0-014049a006b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:02.063707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-225a090f-ed85-4695-b4c0-014049a006b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:02.130947 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-225a090f-ed85-4695-b4c0-014049a006b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:02.138658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-225a090f-ed85-4695-b4c0-014049a006b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1316 microversion: 2.1 time: 0.087498 Jul 26 16:39:02.139584 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 339/662] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:02 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1316 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:03.160765 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4c51fa1c-e655-493e-b570-bdf09250fc69 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:03.161376 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4c51fa1c-e655-493e-b570-bdf09250fc69 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:03.167813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4c51fa1c-e655-493e-b570-bdf09250fc69 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:03.168260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4c51fa1c-e655-493e-b570-bdf09250fc69 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:03.169092 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4c51fa1c-e655-493e-b570-bdf09250fc69 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:03.169531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4c51fa1c-e655-493e-b570-bdf09250fc69 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:03.304263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-a09a0bd3-8d17-44c3-b4af-1594b0c74294 req-758d04fc-d847-4ef4-8788-afc4a5f78fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c11953c-a484-4d00-a221-e03e55f46dc4", "tag": "a0a91c54-eff1-4606-86a1-f907fac4dfa0"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:39:03.320307 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-a09a0bd3-8d17-44c3-b4af-1594b0c74294 req-758d04fc-d847-4ef4-8788-afc4a5f78fe2 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:03.321083 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-a09a0bd3-8d17-44c3-b4af-1594b0c74294 req-758d04fc-d847-4ef4-8788-afc4a5f78fe2 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:03.335275 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-a09a0bd3-8d17-44c3-b4af-1594b0c74294 req-758d04fc-d847-4ef4-8788-afc4a5f78fe2 service nova] Creating event network-changed:a0a91c54-eff1-4606-86a1-f907fac4dfa0 for instance 5c11953c-a484-4d00-a221-e03e55f46dc4 on hv-cinder-85104 Jul 26 16:39:03.342747 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-a09a0bd3-8d17-44c3-b4af-1594b0c74294 req-758d04fc-d847-4ef4-8788-afc4a5f78fe2 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044042 Jul 26 16:39:03.344835 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 340/663] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:39:03.379371 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4c51fa1c-e655-493e-b570-bdf09250fc69 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:03.387541 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4c51fa1c-e655-493e-b570-bdf09250fc69 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1371 microversion: 2.1 time: 0.230710 Jul 26 16:39:03.388113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 324/664] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:03 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:04.409332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7f3ff985-b2a2-4778-a949-161a4a5a5a41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:04.410058 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7f3ff985-b2a2-4778-a949-161a4a5a5a41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:04.416735 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f3ff985-b2a2-4778-a949-161a4a5a5a41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:04.417184 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f3ff985-b2a2-4778-a949-161a4a5a5a41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:04.417942 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f3ff985-b2a2-4778-a949-161a4a5a5a41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:04.418378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f3ff985-b2a2-4778-a949-161a4a5a5a41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:04.545684 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7f3ff985-b2a2-4778-a949-161a4a5a5a41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:04.553059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7f3ff985-b2a2-4778-a949-161a4a5a5a41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1371 microversion: 2.1 time: 0.148503 Jul 26 16:39:04.553612 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 341/665] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:04 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:05.574326 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-94c63d11-d06d-40c3-873e-fb050eb9cbb6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:05.574934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-94c63d11-d06d-40c3-873e-fb050eb9cbb6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:05.577251 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:05.582721 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94c63d11-d06d-40c3-873e-fb050eb9cbb6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:05.583228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94c63d11-d06d-40c3-873e-fb050eb9cbb6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:05.590218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94c63d11-d06d-40c3-873e-fb050eb9cbb6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:05.590218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94c63d11-d06d-40c3-873e-fb050eb9cbb6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:05.712427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-94c63d11-d06d-40c3-873e-fb050eb9cbb6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:05.721084 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-94c63d11-d06d-40c3-873e-fb050eb9cbb6 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1371 microversion: 2.1 time: 0.150659 Jul 26 16:39:05.721660 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 325/666] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:05 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:06.742794 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c1c9c0ae-8269-4afd-b11e-f29d08bdf69d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:06.743444 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c1c9c0ae-8269-4afd-b11e-f29d08bdf69d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:06.751009 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c1c9c0ae-8269-4afd-b11e-f29d08bdf69d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:06.751412 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c1c9c0ae-8269-4afd-b11e-f29d08bdf69d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:06.752165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c1c9c0ae-8269-4afd-b11e-f29d08bdf69d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:06.752630 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c1c9c0ae-8269-4afd-b11e-f29d08bdf69d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:06.884948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c1c9c0ae-8269-4afd-b11e-f29d08bdf69d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:06.893013 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c1c9c0ae-8269-4afd-b11e-f29d08bdf69d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1371 microversion: 2.1 time: 0.154478 Jul 26 16:39:06.894694 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 342/667] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:06 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:07.913932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-eab1a00d-e0e0-411f-8f30-224d3b12e854 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:07.914469 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-eab1a00d-e0e0-411f-8f30-224d3b12e854 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:07.920850 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eab1a00d-e0e0-411f-8f30-224d3b12e854 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:07.921299 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eab1a00d-e0e0-411f-8f30-224d3b12e854 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:07.922083 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eab1a00d-e0e0-411f-8f30-224d3b12e854 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:07.922563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eab1a00d-e0e0-411f-8f30-224d3b12e854 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:08.053095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-eab1a00d-e0e0-411f-8f30-224d3b12e854 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:08.060485 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-eab1a00d-e0e0-411f-8f30-224d3b12e854 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1371 microversion: 2.1 time: 0.150352 Jul 26 16:39:08.061042 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 326/668] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:07 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:09.081555 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1548ed26-e9dd-4310-b527-020609641ffd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:09.082169 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1548ed26-e9dd-4310-b527-020609641ffd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:09.084110 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=8 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:09.089396 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1548ed26-e9dd-4310-b527-020609641ffd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:09.089841 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1548ed26-e9dd-4310-b527-020609641ffd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:09.090609 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1548ed26-e9dd-4310-b527-020609641ffd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:09.091029 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1548ed26-e9dd-4310-b527-020609641ffd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:09.222597 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1548ed26-e9dd-4310-b527-020609641ffd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:09.230115 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1548ed26-e9dd-4310-b527-020609641ffd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1371 microversion: 2.1 time: 0.152543 Jul 26 16:39:09.230685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 343/669] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:09 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:09.784013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=10 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:09.838447 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-1a1c5d15-6811-4bce-8122-f2a658ff3221 req-eaa2607f-9c34-4bc5-a8e9-89c3ac24af28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c11953c-a484-4d00-a221-e03e55f46dc4", "name": "network-vif-plugged", "status": "completed", "tag": "a0a91c54-eff1-4606-86a1-f907fac4dfa0"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:39:09.848354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-1a1c5d15-6811-4bce-8122-f2a658ff3221 req-eaa2607f-9c34-4bc5-a8e9-89c3ac24af28 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:09.848826 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-1a1c5d15-6811-4bce-8122-f2a658ff3221 req-eaa2607f-9c34-4bc5-a8e9-89c3ac24af28 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:09.861016 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-1a1c5d15-6811-4bce-8122-f2a658ff3221 req-eaa2607f-9c34-4bc5-a8e9-89c3ac24af28 service nova] Creating event network-vif-plugged:a0a91c54-eff1-4606-86a1-f907fac4dfa0 for instance 5c11953c-a484-4d00-a221-e03e55f46dc4 on hv-cinder-85104 Jul 26 16:39:09.866016 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-1a1c5d15-6811-4bce-8122-f2a658ff3221 req-eaa2607f-9c34-4bc5-a8e9-89c3ac24af28 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087394 Jul 26 16:39:09.866645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 327/670] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:39:10.251143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f66173ca-b895-485a-99f6-424da6faf4e9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:10.251831 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f66173ca-b895-485a-99f6-424da6faf4e9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:10.258463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f66173ca-b895-485a-99f6-424da6faf4e9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:10.258908 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f66173ca-b895-485a-99f6-424da6faf4e9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:10.259709 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f66173ca-b895-485a-99f6-424da6faf4e9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:10.260138 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f66173ca-b895-485a-99f6-424da6faf4e9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:10.264210 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:10.388996 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f66173ca-b895-485a-99f6-424da6faf4e9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:10.397115 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f66173ca-b895-485a-99f6-424da6faf4e9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1371 microversion: 2.1 time: 0.149837 Jul 26 16:39:10.397670 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 344/671] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:10 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:11.419167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5d0ef420-72d6-4eca-8d73-80211e1f41bf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:11.419998 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5d0ef420-72d6-4eca-8d73-80211e1f41bf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:11.426590 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5d0ef420-72d6-4eca-8d73-80211e1f41bf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:11.427033 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5d0ef420-72d6-4eca-8d73-80211e1f41bf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:11.427781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5d0ef420-72d6-4eca-8d73-80211e1f41bf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:11.428209 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5d0ef420-72d6-4eca-8d73-80211e1f41bf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:11.431368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:11.559869 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5d0ef420-72d6-4eca-8d73-80211e1f41bf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:11.567942 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5d0ef420-72d6-4eca-8d73-80211e1f41bf tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1371 microversion: 2.1 time: 0.153363 Jul 26 16:39:11.568533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 328/672] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:11 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:12.589561 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4c76da9b-0b8d-45d7-a255-e60eb4535caa tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:12.590159 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4c76da9b-0b8d-45d7-a255-e60eb4535caa tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:12.597348 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4c76da9b-0b8d-45d7-a255-e60eb4535caa tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:12.599391 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4c76da9b-0b8d-45d7-a255-e60eb4535caa tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:12.599391 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4c76da9b-0b8d-45d7-a255-e60eb4535caa tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:12.599391 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4c76da9b-0b8d-45d7-a255-e60eb4535caa tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:12.730375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4c76da9b-0b8d-45d7-a255-e60eb4535caa tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:12.738345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4c76da9b-0b8d-45d7-a255-e60eb4535caa tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1371 microversion: 2.1 time: 0.152649 Jul 26 16:39:12.738907 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 345/673] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:12 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:13.759814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7af2899e-93f7-4753-bb25-38608d08d13b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:13.760350 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7af2899e-93f7-4753-bb25-38608d08d13b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:13.767815 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7af2899e-93f7-4753-bb25-38608d08d13b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:13.768257 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7af2899e-93f7-4753-bb25-38608d08d13b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:13.769051 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7af2899e-93f7-4753-bb25-38608d08d13b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:13.769482 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7af2899e-93f7-4753-bb25-38608d08d13b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:14.154731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7af2899e-93f7-4753-bb25-38608d08d13b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:14.162116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7af2899e-93f7-4753-bb25-38608d08d13b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1561 microversion: 2.1 time: 0.406856 Jul 26 16:39:14.162678 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 329/674] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:13 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1561 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:14.182366 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c0e53aef-206f-4fc8-8519-6abe8343a58a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:14.182881 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c0e53aef-206f-4fc8-8519-6abe8343a58a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:14.189745 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c0e53aef-206f-4fc8-8519-6abe8343a58a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:14.190186 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c0e53aef-206f-4fc8-8519-6abe8343a58a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:14.190930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c0e53aef-206f-4fc8-8519-6abe8343a58a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:14.191355 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c0e53aef-206f-4fc8-8519-6abe8343a58a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:14.265861 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c0e53aef-206f-4fc8-8519-6abe8343a58a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087187 Jul 26 16:39:14.266446 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 346/675] 10.222.0.144 () {58 vars in 1280 bytes} [Tue Jul 26 16:39:14 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:14.562665 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-379e0d24-748e-46cc-85d2-02ff59db2db5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:14.563156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-379e0d24-748e-46cc-85d2-02ff59db2db5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:14.569189 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-379e0d24-748e-46cc-85d2-02ff59db2db5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:14.569639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-379e0d24-748e-46cc-85d2-02ff59db2db5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:14.570401 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-379e0d24-748e-46cc-85d2-02ff59db2db5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:14.570836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-379e0d24-748e-46cc-85d2-02ff59db2db5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:14.653358 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-379e0d24-748e-46cc-85d2-02ff59db2db5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lazy-loading 'services' on Instance uuid 7b3a6262-8adc-4597-8d00-35af06cee7de {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:39:14.863038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-379e0d24-748e-46cc-85d2-02ff59db2db5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "DELETE /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments/dd88420c-63e1-453c-bcf7-1f05274aeb14" status: 202 len: 0 microversion: 2.1 time: 0.304075 Jul 26 16:39:14.863736 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 330/676] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:39:14 2022] DELETE /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments/dd88420c-63e1-453c-bcf7-1f05274aeb14 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:39:14.872662 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d4107dd1-deee-4bb6-b78d-ad0158e61763 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:14.875088 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d4107dd1-deee-4bb6-b78d-ad0158e61763 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:14.881558 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d4107dd1-deee-4bb6-b78d-ad0158e61763 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:14.882024 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d4107dd1-deee-4bb6-b78d-ad0158e61763 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:14.882933 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d4107dd1-deee-4bb6-b78d-ad0158e61763 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:14.883398 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d4107dd1-deee-4bb6-b78d-ad0158e61763 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:14.915301 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d4107dd1-deee-4bb6-b78d-ad0158e61763 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046623 Jul 26 16:39:14.917887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 347/677] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:39:14 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:15.513516 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-5e485238-9127-4612-8dba-9deb6d5045d4 req-b48bca5a-2d93-411e-b266-ae3b0c9ad24c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c11953c-a484-4d00-a221-e03e55f46dc4", "tag": "a0a91c54-eff1-4606-86a1-f907fac4dfa0"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:39:15.523686 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-5e485238-9127-4612-8dba-9deb6d5045d4 req-b48bca5a-2d93-411e-b266-ae3b0c9ad24c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:15.528709 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-5e485238-9127-4612-8dba-9deb6d5045d4 req-b48bca5a-2d93-411e-b266-ae3b0c9ad24c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:15.536987 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-5e485238-9127-4612-8dba-9deb6d5045d4 req-b48bca5a-2d93-411e-b266-ae3b0c9ad24c service nova] Creating event network-changed:a0a91c54-eff1-4606-86a1-f907fac4dfa0 for instance 5c11953c-a484-4d00-a221-e03e55f46dc4 on hv-cinder-85104 Jul 26 16:39:15.542398 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-5e485238-9127-4612-8dba-9deb6d5045d4 req-b48bca5a-2d93-411e-b266-ae3b0c9ad24c service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093275 Jul 26 16:39:15.543063 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 331/678] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:15.927800 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6dd261db-24ce-4204-b609-f9b61d9bddac tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:15.929954 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6dd261db-24ce-4204-b609-f9b61d9bddac tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:15.937503 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6dd261db-24ce-4204-b609-f9b61d9bddac tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:15.938482 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6dd261db-24ce-4204-b609-f9b61d9bddac tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:15.939263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6dd261db-24ce-4204-b609-f9b61d9bddac tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:15.939697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6dd261db-24ce-4204-b609-f9b61d9bddac tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:15.971196 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6dd261db-24ce-4204-b609-f9b61d9bddac tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047803 Jul 26 16:39:15.977952 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 348/679] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:39:15 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:16.009880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-46bbeb2e-f889-4108-9d8a-f7a618893182 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:39:16.011151 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-46bbeb2e-f889-4108-9d8a-f7a618893182 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:16.020432 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-46bbeb2e-f889-4108-9d8a-f7a618893182 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:16.022339 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-46bbeb2e-f889-4108-9d8a-f7a618893182 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:16.023519 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-46bbeb2e-f889-4108-9d8a-f7a618893182 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:16.023935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-46bbeb2e-f889-4108-9d8a-f7a618893182 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:16.049991 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-46bbeb2e-f889-4108-9d8a-f7a618893182 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lazy-loading 'flavor' on Instance uuid 976970b3-530e-4bc0-a609-bc3d8ac750a8 {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:39:16.382190 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-46bbeb2e-f889-4108-9d8a-f7a618893182 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "POST /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8/action" status: 202 len: 0 microversion: 2.1 time: 0.376770 Jul 26 16:39:16.382781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 332/680] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:39:16 2022] POST /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:39:16.391475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a1097bcb-ca75-4400-a21f-7dc259bc4a08 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:16.392184 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a1097bcb-ca75-4400-a21f-7dc259bc4a08 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:16.398230 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1097bcb-ca75-4400-a21f-7dc259bc4a08 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:16.398672 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1097bcb-ca75-4400-a21f-7dc259bc4a08 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:16.399468 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1097bcb-ca75-4400-a21f-7dc259bc4a08 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:16.399901 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1097bcb-ca75-4400-a21f-7dc259bc4a08 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:16.540605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a1097bcb-ca75-4400-a21f-7dc259bc4a08 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:16.549234 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a1097bcb-ca75-4400-a21f-7dc259bc4a08 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.161638 Jul 26 16:39:16.549811 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 349/681] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:16 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:16.984284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-17fc8b32-6a06-4242-a5bd-966447171ea0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:16.986640 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-17fc8b32-6a06-4242-a5bd-966447171ea0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:16.992826 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17fc8b32-6a06-4242-a5bd-966447171ea0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:16.993276 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17fc8b32-6a06-4242-a5bd-966447171ea0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:16.994035 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17fc8b32-6a06-4242-a5bd-966447171ea0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:16.994468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17fc8b32-6a06-4242-a5bd-966447171ea0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:17.027871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-17fc8b32-6a06-4242-a5bd-966447171ea0 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047798 Jul 26 16:39:17.028580 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 333/682] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:39:16 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 16:39:17.102625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6995bfa7-0f1c-4f41-8bf6-e17f7e95d720 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:17.103135 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6995bfa7-0f1c-4f41-8bf6-e17f7e95d720 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:17.109562 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6995bfa7-0f1c-4f41-8bf6-e17f7e95d720 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:17.110009 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6995bfa7-0f1c-4f41-8bf6-e17f7e95d720 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:17.110755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6995bfa7-0f1c-4f41-8bf6-e17f7e95d720 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:17.111183 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6995bfa7-0f1c-4f41-8bf6-e17f7e95d720 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:17.135232 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6995bfa7-0f1c-4f41-8bf6-e17f7e95d720 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Going to try to terminate instance {{(pid=124821) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:39:17.443127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6995bfa7-0f1c-4f41-8bf6-e17f7e95d720 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "DELETE /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 204 len: 0 microversion: 2.1 time: 0.344003 Jul 26 16:39:17.443717 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 350/683] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:39:17 2022] DELETE /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:39:17.451628 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ea7afe94-e6f4-40ae-af84-bdb3d0a3fee1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:17.452241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ea7afe94-e6f4-40ae-af84-bdb3d0a3fee1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:17.458944 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ea7afe94-e6f4-40ae-af84-bdb3d0a3fee1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:17.464842 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ea7afe94-e6f4-40ae-af84-bdb3d0a3fee1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:17.464842 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ea7afe94-e6f4-40ae-af84-bdb3d0a3fee1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:17.464842 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ea7afe94-e6f4-40ae-af84-bdb3d0a3fee1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:17.573127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2c9c8d4d-ba6a-43c7-a33b-785af44ee75e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:17.582514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2c9c8d4d-ba6a-43c7-a33b-785af44ee75e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:17.582514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2c9c8d4d-ba6a-43c7-a33b-785af44ee75e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:17.582514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2c9c8d4d-ba6a-43c7-a33b-785af44ee75e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:17.582956 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2c9c8d4d-ba6a-43c7-a33b-785af44ee75e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:17.583212 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2c9c8d4d-ba6a-43c7-a33b-785af44ee75e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:17.602242 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ea7afe94-e6f4-40ae-af84-bdb3d0a3fee1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:17.610459 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ea7afe94-e6f4-40ae-af84-bdb3d0a3fee1 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1693 microversion: 2.1 time: 0.161998 Jul 26 16:39:17.611040 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 334/684] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:17 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:17.715346 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2c9c8d4d-ba6a-43c7-a33b-785af44ee75e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:17.723117 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2c9c8d4d-ba6a-43c7-a33b-785af44ee75e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.155350 Jul 26 16:39:17.723758 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 351/685] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:17 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:18.631013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ae13b32e-c830-45a5-9e9a-b920529669f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:18.631630 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ae13b32e-c830-45a5-9e9a-b920529669f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:18.638237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae13b32e-c830-45a5-9e9a-b920529669f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:18.638691 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae13b32e-c830-45a5-9e9a-b920529669f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:18.639455 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae13b32e-c830-45a5-9e9a-b920529669f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:18.639896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae13b32e-c830-45a5-9e9a-b920529669f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:18.744677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d70e143a-1044-4131-b945-8f2e32147ac7 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:18.745427 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d70e143a-1044-4131-b945-8f2e32147ac7 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:18.752562 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d70e143a-1044-4131-b945-8f2e32147ac7 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:18.753007 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d70e143a-1044-4131-b945-8f2e32147ac7 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:18.753763 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d70e143a-1044-4131-b945-8f2e32147ac7 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:18.754187 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d70e143a-1044-4131-b945-8f2e32147ac7 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:18.771767 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ae13b32e-c830-45a5-9e9a-b920529669f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:18.779573 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ae13b32e-c830-45a5-9e9a-b920529669f4 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1693 microversion: 2.1 time: 0.152393 Jul 26 16:39:18.780129 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 335/686] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:18 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1693 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:18.882327 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d70e143a-1044-4131-b945-8f2e32147ac7 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:18.889762 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d70e143a-1044-4131-b945-8f2e32147ac7 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.148948 Jul 26 16:39:18.890319 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 352/687] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:18 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:19.801087 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-61c8551e-88b5-43ac-9cb5-f132287ac58f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:19.801606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-61c8551e-88b5-43ac-9cb5-f132287ac58f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:19.807973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-61c8551e-88b5-43ac-9cb5-f132287ac58f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:19.808439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-61c8551e-88b5-43ac-9cb5-f132287ac58f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:19.809193 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-61c8551e-88b5-43ac-9cb5-f132287ac58f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:19.809623 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-61c8551e-88b5-43ac-9cb5-f132287ac58f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:19.911609 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c5a40f79-0232-4b8d-8f71-5839962c9455 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:19.912245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c5a40f79-0232-4b8d-8f71-5839962c9455 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:19.919003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c5a40f79-0232-4b8d-8f71-5839962c9455 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:19.919451 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c5a40f79-0232-4b8d-8f71-5839962c9455 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:19.920211 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c5a40f79-0232-4b8d-8f71-5839962c9455 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:19.920684 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c5a40f79-0232-4b8d-8f71-5839962c9455 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:19.936915 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-61c8551e-88b5-43ac-9cb5-f132287ac58f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:19.944437 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-61c8551e-88b5-43ac-9cb5-f132287ac58f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1693 microversion: 2.1 time: 0.147835 Jul 26 16:39:19.945014 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 336/688] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:19 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1693 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:20.060719 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c5a40f79-0232-4b8d-8f71-5839962c9455 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:20.068136 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c5a40f79-0232-4b8d-8f71-5839962c9455 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.160316 Jul 26 16:39:20.068727 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 353/689] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:19 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:20.966082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fe4956ea-52d4-48f6-b95a-286fc56a2a3f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:20.966680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fe4956ea-52d4-48f6-b95a-286fc56a2a3f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:20.973231 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe4956ea-52d4-48f6-b95a-286fc56a2a3f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:20.973673 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe4956ea-52d4-48f6-b95a-286fc56a2a3f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:20.974427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe4956ea-52d4-48f6-b95a-286fc56a2a3f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:20.974853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe4956ea-52d4-48f6-b95a-286fc56a2a3f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:21.089490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-91c7fb74-661d-490c-a1db-6a8be36ac220 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:21.090102 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-91c7fb74-661d-490c-a1db-6a8be36ac220 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:21.092476 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:21.097685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-91c7fb74-661d-490c-a1db-6a8be36ac220 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:21.098141 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-91c7fb74-661d-490c-a1db-6a8be36ac220 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:21.098907 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-91c7fb74-661d-490c-a1db-6a8be36ac220 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:21.099340 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-91c7fb74-661d-490c-a1db-6a8be36ac220 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:21.120526 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fe4956ea-52d4-48f6-b95a-286fc56a2a3f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:21.127951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fe4956ea-52d4-48f6-b95a-286fc56a2a3f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1693 microversion: 2.1 time: 0.165848 Jul 26 16:39:21.134010 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 337/690] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:20 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1693 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:21.234106 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-91c7fb74-661d-490c-a1db-6a8be36ac220 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:21.242337 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-91c7fb74-661d-490c-a1db-6a8be36ac220 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.156659 Jul 26 16:39:21.242894 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 354/691] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:21 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:22.148254 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bd8c6229-bca3-4c83-ad07-47179a8ef240 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:22.148895 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bd8c6229-bca3-4c83-ad07-47179a8ef240 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:22.155668 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd8c6229-bca3-4c83-ad07-47179a8ef240 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:22.167605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd8c6229-bca3-4c83-ad07-47179a8ef240 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:22.167605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd8c6229-bca3-4c83-ad07-47179a8ef240 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:22.167605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd8c6229-bca3-4c83-ad07-47179a8ef240 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:22.263006 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a31e51e7-26b3-40fb-9fec-206365f3152e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:22.263615 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a31e51e7-26b3-40fb-9fec-206365f3152e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:22.270295 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a31e51e7-26b3-40fb-9fec-206365f3152e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:22.270742 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a31e51e7-26b3-40fb-9fec-206365f3152e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:22.271503 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a31e51e7-26b3-40fb-9fec-206365f3152e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:22.271937 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a31e51e7-26b3-40fb-9fec-206365f3152e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:22.345645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bd8c6229-bca3-4c83-ad07-47179a8ef240 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:22.352917 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bd8c6229-bca3-4c83-ad07-47179a8ef240 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1693 microversion: 2.1 time: 0.207937 Jul 26 16:39:22.356545 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 338/692] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:22 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:22.407091 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a31e51e7-26b3-40fb-9fec-206365f3152e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:22.414975 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a31e51e7-26b3-40fb-9fec-206365f3152e tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.155684 Jul 26 16:39:22.419454 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 355/693] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:22 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:22.716847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-2f15f9a8-a6c1-4422-aa1d-17fa7319800f req-631f3304-1d6f-496f-b964-4028579cfad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b3a6262-8adc-4597-8d00-35af06cee7de", "name": "network-vif-deleted", "tag": "b93e292a-28ec-4647-a984-c0d6bb8814e5"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:39:22.727548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-2f15f9a8-a6c1-4422-aa1d-17fa7319800f req-631f3304-1d6f-496f-b964-4028579cfad3 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:22.731338 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-2f15f9a8-a6c1-4422-aa1d-17fa7319800f req-631f3304-1d6f-496f-b964-4028579cfad3 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:22.739856 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-2f15f9a8-a6c1-4422-aa1d-17fa7319800f req-631f3304-1d6f-496f-b964-4028579cfad3 service nova] Creating event network-vif-deleted:b93e292a-28ec-4647-a984-c0d6bb8814e5 for instance 7b3a6262-8adc-4597-8d00-35af06cee7de on hv-cinder-85104 Jul 26 16:39:22.745339 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-2f15f9a8-a6c1-4422-aa1d-17fa7319800f req-631f3304-1d6f-496f-b964-4028579cfad3 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033168 Jul 26 16:39:22.746006 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 339/694] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:23.373725 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:23.374450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:23.381982 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:23.382463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:23.383261 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:23.383698 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:23.417212 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:23.417806 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:23.418329 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lazy-loading 'fault' on Instance uuid 7b3a6262-8adc-4597-8d00-35af06cee7de {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:39:23.438409 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-490563dd-3f3d-4d00-8968-a42f78e4aa42 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:23.439878 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-490563dd-3f3d-4d00-8968-a42f78e4aa42 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:23.448004 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-490563dd-3f3d-4d00-8968-a42f78e4aa42 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:23.448831 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-490563dd-3f3d-4d00-8968-a42f78e4aa42 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:23.450015 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-490563dd-3f3d-4d00-8968-a42f78e4aa42 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:23.450796 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-490563dd-3f3d-4d00-8968-a42f78e4aa42 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:23.478449 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:23.487098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-782ce3e8-5620-41f9-b897-4a508864784e tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 200 len: 1339 microversion: 2.1 time: 0.116995 Jul 26 16:39:23.496631 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 356/695] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:23 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 1339 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:23.598861 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-490563dd-3f3d-4d00-8968-a42f78e4aa42 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:23.606748 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-490563dd-3f3d-4d00-8968-a42f78e4aa42 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.173604 Jul 26 16:39:23.607326 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 340/696] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:23 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:24.509123 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cf7556d7-0972-470e-9362-5f06a57a90a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:24.509725 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-cf7556d7-0972-470e-9362-5f06a57a90a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 7b3a6262-8adc-4597-8d00-35af06cee7de] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:24.516170 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf7556d7-0972-470e-9362-5f06a57a90a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:24.516658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf7556d7-0972-470e-9362-5f06a57a90a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:24.517413 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf7556d7-0972-470e-9362-5f06a57a90a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:24.517841 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf7556d7-0972-470e-9362-5f06a57a90a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:24.530937 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-cf7556d7-0972-470e-9362-5f06a57a90a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] HTTP exception thrown: Instance 7b3a6262-8adc-4597-8d00-35af06cee7de could not be found. Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cf7556d7-0972-470e-9362-5f06a57a90a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Request method failure captured: Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de HTTP/1.1 Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BcttderPmzD14SOzevUatQn_f-KHC5OwGIojgRdyaUAc4Q1splEtFnf0Amz--8kn0btqR7qNv-Oau7NZOr9CIrJ1ECpBFaPA389wG3XOEox8RN_ElBs6FWCM-M77RP2f4-NCuQPVbu8Asiz1iIG5mD8gksIoGny2uALegpP_gIpua4 Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 08a954085f8f454698c55faa9351ad6e Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:39:24.532559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_08a954085f8f454698c55faa9351ad6e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 08a954085f8f454698c55faa9351ad6e Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-ServerRescueNegativeTestJSON-450575223-project Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 07e70b1c968443eab469777283b8fb50 Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-ServerRescueNegativeTestJSON-450575223-project Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 7b3a6262-8adc-4597-8d00-35af06cee7de could not be found. Jul 26 16:39:24.534155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '7b3a6262-8adc-4597-8d00-35af06cee7de'} Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b3a6262-8adc-4597-8d00-35af06cee7de could not be found. Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:39:24.535062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b3a6262-8adc-4597-8d00-35af06cee7de could not be found. Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b3a6262-8adc-4597-8d00-35af06cee7de could not be found. Jul 26 16:39:24.536666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:39:24.538256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cf7556d7-0972-470e-9362-5f06a57a90a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Returning 404 to user: Instance 7b3a6262-8adc-4597-8d00-35af06cee7de could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:39:24.538256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-cf7556d7-0972-470e-9362-5f06a57a90a3 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de" status: 404 len: 111 microversion: 2.1 time: 0.028671 Jul 26 16:39:24.538256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 357/697] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:24 2022] GET /compute/v2.1/servers/7b3a6262-8adc-4597-8d00-35af06cee7de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:39:24.542311 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4d1068ff-998e-4deb-a4da-e421a3131d6a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '.version_select at 0x7f4b6c02e430>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:24.630041 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7ee62820-916a-4171-a9d3-35c15269cb3a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:24.630684 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7ee62820-916a-4171-a9d3-35c15269cb3a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:24.632356 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4d1068ff-998e-4deb-a4da-e421a3131d6a tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747126979" status: 202 len: 0 microversion: 2.1 time: 0.093693 Jul 26 16:39:24.632965 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 341/698] 10.222.0.144 () {58 vars in 1226 bytes} [Tue Jul 26 16:39:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747126979 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:39:24.637666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ee62820-916a-4171-a9d3-35c15269cb3a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:24.640038 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ee62820-916a-4171-a9d3-35c15269cb3a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:24.640038 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ee62820-916a-4171-a9d3-35c15269cb3a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:24.640038 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ee62820-916a-4171-a9d3-35c15269cb3a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:24.828061 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7ee62820-916a-4171-a9d3-35c15269cb3a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:24.835602 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7ee62820-916a-4171-a9d3-35c15269cb3a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.210048 Jul 26 16:39:24.836590 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 358/699] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:24 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:25.858269 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-06de0890-8a00-412a-9bd8-1f5554f7418d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:25.858874 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-06de0890-8a00-412a-9bd8-1f5554f7418d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:25.860831 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:25.866093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-06de0890-8a00-412a-9bd8-1f5554f7418d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:25.866541 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-06de0890-8a00-412a-9bd8-1f5554f7418d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:25.867293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-06de0890-8a00-412a-9bd8-1f5554f7418d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:25.867723 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-06de0890-8a00-412a-9bd8-1f5554f7418d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:25.997304 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-06de0890-8a00-412a-9bd8-1f5554f7418d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:26.005753 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-06de0890-8a00-412a-9bd8-1f5554f7418d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.151996 Jul 26 16:39:26.006336 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 342/700] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:25 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:27.027727 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-48f78b74-7021-4614-b40e-c6ac3a392285 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:27.028333 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-48f78b74-7021-4614-b40e-c6ac3a392285 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:27.035539 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48f78b74-7021-4614-b40e-c6ac3a392285 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:27.038739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48f78b74-7021-4614-b40e-c6ac3a392285 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:27.038739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48f78b74-7021-4614-b40e-c6ac3a392285 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:27.038739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48f78b74-7021-4614-b40e-c6ac3a392285 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:27.173662 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-48f78b74-7021-4614-b40e-c6ac3a392285 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:27.177126 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:27.181463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-48f78b74-7021-4614-b40e-c6ac3a392285 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.158277 Jul 26 16:39:27.182022 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 359/701] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:27 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:27.981446 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e439f6bf-b417-4c56-98cc-b649e03be10f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:27.981945 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e439f6bf-b417-4c56-98cc-b649e03be10f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:27.988473 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e439f6bf-b417-4c56-98cc-b649e03be10f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:27.988931 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e439f6bf-b417-4c56-98cc-b649e03be10f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:27.989692 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e439f6bf-b417-4c56-98cc-b649e03be10f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:27.990132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e439f6bf-b417-4c56-98cc-b649e03be10f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:28.014618 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e439f6bf-b417-4c56-98cc-b649e03be10f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:39:28.037996 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:28.202420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-953bc621-7661-46d3-be10-ac8021b3c9be tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:28.203028 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-953bc621-7661-46d3-be10-ac8021b3c9be tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:28.209907 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-953bc621-7661-46d3-be10-ac8021b3c9be tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:28.210299 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-953bc621-7661-46d3-be10-ac8021b3c9be tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:28.211061 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-953bc621-7661-46d3-be10-ac8021b3c9be tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:28.211494 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-953bc621-7661-46d3-be10-ac8021b3c9be tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:28.346617 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-953bc621-7661-46d3-be10-ac8021b3c9be tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:28.354248 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-953bc621-7661-46d3-be10-ac8021b3c9be tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.155960 Jul 26 16:39:28.354803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 360/702] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:28 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:28.366429 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e439f6bf-b417-4c56-98cc-b649e03be10f tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "DELETE /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 204 len: 0 microversion: 2.1 time: 0.388530 Jul 26 16:39:28.368805 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 343/703] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:39:27 2022] DELETE /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:39:28.375499 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f19df00d-8213-41a9-a030-3d5240cc7929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:28.376104 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f19df00d-8213-41a9-a030-3d5240cc7929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:28.382384 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f19df00d-8213-41a9-a030-3d5240cc7929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:28.382833 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f19df00d-8213-41a9-a030-3d5240cc7929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:28.383596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f19df00d-8213-41a9-a030-3d5240cc7929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:28.384029 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f19df00d-8213-41a9-a030-3d5240cc7929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:28.513918 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f19df00d-8213-41a9-a030-3d5240cc7929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:28.522054 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f19df00d-8213-41a9-a030-3d5240cc7929 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1510 microversion: 2.1 time: 0.150577 Jul 26 16:39:28.522906 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 361/704] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:28 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:29.377360 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c378337f-d695-41b5-8013-d5cb113eb44b tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:29.378064 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c378337f-d695-41b5-8013-d5cb113eb44b tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:29.384574 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c378337f-d695-41b5-8013-d5cb113eb44b tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:29.385020 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c378337f-d695-41b5-8013-d5cb113eb44b tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:29.385773 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c378337f-d695-41b5-8013-d5cb113eb44b tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:29.386199 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c378337f-d695-41b5-8013-d5cb113eb44b tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:29.514459 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c378337f-d695-41b5-8013-d5cb113eb44b tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:29.522751 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c378337f-d695-41b5-8013-d5cb113eb44b tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.150286 Jul 26 16:39:29.523316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 344/705] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:29 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:29.542889 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e39c955d-5883-408f-92d0-e1d4d399e843 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:29.543490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e39c955d-5883-408f-92d0-e1d4d399e843 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:29.550144 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e39c955d-5883-408f-92d0-e1d4d399e843 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:29.550589 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e39c955d-5883-408f-92d0-e1d4d399e843 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:29.551359 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e39c955d-5883-408f-92d0-e1d4d399e843 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:29.551788 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e39c955d-5883-408f-92d0-e1d4d399e843 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:29.687454 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e39c955d-5883-408f-92d0-e1d4d399e843 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:29.696320 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e39c955d-5883-408f-92d0-e1d4d399e843 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1510 microversion: 2.1 time: 0.157213 Jul 26 16:39:29.696911 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 362/706] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:29 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:30.247022 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-e1fe98b5-4d67-4e55-9094-660adfcb7cff req-6568e112-e7e5-49f2-a963-5890a82b473d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ee205ae-99c2-4fe2-8160-e336188072b0", "name": "network-vif-deleted", "tag": "8ff0a433-a61a-4d2f-8754-b2d35e4d59b4"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:39:30.256792 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-e1fe98b5-4d67-4e55-9094-660adfcb7cff req-6568e112-e7e5-49f2-a963-5890a82b473d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:30.257238 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-e1fe98b5-4d67-4e55-9094-660adfcb7cff req-6568e112-e7e5-49f2-a963-5890a82b473d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:30.268196 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-e1fe98b5-4d67-4e55-9094-660adfcb7cff req-6568e112-e7e5-49f2-a963-5890a82b473d service nova] Creating event network-vif-deleted:8ff0a433-a61a-4d2f-8754-b2d35e4d59b4 for instance 5ee205ae-99c2-4fe2-8160-e336188072b0 on hv-cinder-85104 Jul 26 16:39:30.273117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-e1fe98b5-4d67-4e55-9094-660adfcb7cff req-6568e112-e7e5-49f2-a963-5890a82b473d service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029760 Jul 26 16:39:30.276121 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 345/707] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:30.543619 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-41afffff-4fe2-4d3d-920c-429f0d0195a3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:30.544324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-41afffff-4fe2-4d3d-920c-429f0d0195a3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:30.550722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41afffff-4fe2-4d3d-920c-429f0d0195a3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:30.551095 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41afffff-4fe2-4d3d-920c-429f0d0195a3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:30.551589 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41afffff-4fe2-4d3d-920c-429f0d0195a3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:30.552022 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41afffff-4fe2-4d3d-920c-429f0d0195a3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:30.687424 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-41afffff-4fe2-4d3d-920c-429f0d0195a3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:30.695506 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-41afffff-4fe2-4d3d-920c-429f0d0195a3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1573 microversion: 2.1 time: 0.155877 Jul 26 16:39:30.696062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 363/708] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:30 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:30.717229 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7b12b8de-82e1-4127-8ed1-98c3e32a1051 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:39:30.717926 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:30.718734 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7b12b8de-82e1-4127-8ed1-98c3e32a1051 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:30.719043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:30.726197 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:30.726576 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7b12b8de-82e1-4127-8ed1-98c3e32a1051 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:30.726735 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:30.727056 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7b12b8de-82e1-4127-8ed1-98c3e32a1051 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:30.727407 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:30.727813 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7b12b8de-82e1-4127-8ed1-98c3e32a1051 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:30.727955 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:30.728252 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7b12b8de-82e1-4127-8ed1-98c3e32a1051 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:30.761814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:30.762170 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:30.762621 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lazy-loading 'fault' on Instance uuid 5ee205ae-99c2-4fe2-8160-e336188072b0 {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:39:30.804312 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:30.811827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-14188e4b-3bc9-47a5-94d1-7d5befcb0176 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 200 len: 1315 microversion: 2.1 time: 0.098435 Jul 26 16:39:30.812391 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 346/709] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:30 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 1315 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:30.975643 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7b12b8de-82e1-4127-8ed1-98c3e32a1051 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "POST /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8/action" status: 202 len: 0 microversion: 2.1 time: 0.262262 Jul 26 16:39:30.976248 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 364/710] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:39:30 2022] POST /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 16:39:30.984272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3f09cf7d-b9a1-472b-adff-ccfd819cc356 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:30.993061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3f09cf7d-b9a1-472b-adff-ccfd819cc356 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:30.993061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f09cf7d-b9a1-472b-adff-ccfd819cc356 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:30.993061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f09cf7d-b9a1-472b-adff-ccfd819cc356 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:30.993061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f09cf7d-b9a1-472b-adff-ccfd819cc356 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:30.994050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3f09cf7d-b9a1-472b-adff-ccfd819cc356 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:31.131478 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3f09cf7d-b9a1-472b-adff-ccfd819cc356 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:31.139243 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3f09cf7d-b9a1-472b-adff-ccfd819cc356 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1581 microversion: 2.1 time: 0.158703 Jul 26 16:39:31.139815 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 347/711] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:30 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1581 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:31.763197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-806501f4-434d-4dc6-a311-c54f78b2616a req-f4f40699-87fd-4397-ad4c-b7cd3556a65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976970b3-530e-4bc0-a609-bc3d8ac750a8", "name": "network-vif-unplugged", "status": "completed", "tag": "e562fcc8-f654-4575-a60e-9fafbe61bfee"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:39:31.775402 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-806501f4-434d-4dc6-a311-c54f78b2616a req-f4f40699-87fd-4397-ad4c-b7cd3556a65b service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:31.776106 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-806501f4-434d-4dc6-a311-c54f78b2616a req-f4f40699-87fd-4397-ad4c-b7cd3556a65b service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:31.787924 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.compute.server_external_events [req-806501f4-434d-4dc6-a311-c54f78b2616a req-f4f40699-87fd-4397-ad4c-b7cd3556a65b service nova] Unable to find a host for instance 976970b3-530e-4bc0-a609-bc3d8ac750a8. Dropping event network-vif-unplugged {{(pid=124821) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 26 16:39:31.788888 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-806501f4-434d-4dc6-a311-c54f78b2616a req-f4f40699-87fd-4397-ad4c-b7cd3556a65b service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029976 Jul 26 16:39:31.789459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 365/712] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 26 16:39:31.833689 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b7d6cc76-d8a1-4ff4-b022-316e3bee0129 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:31.834243 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b7d6cc76-d8a1-4ff4-b022-316e3bee0129 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: 5ee205ae-99c2-4fe2-8160-e336188072b0] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:31.840875 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b7d6cc76-d8a1-4ff4-b022-316e3bee0129 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:31.841263 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b7d6cc76-d8a1-4ff4-b022-316e3bee0129 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:31.842026 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b7d6cc76-d8a1-4ff4-b022-316e3bee0129 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:31.842495 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b7d6cc76-d8a1-4ff4-b022-316e3bee0129 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:31.857083 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-b7d6cc76-d8a1-4ff4-b022-316e3bee0129 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] HTTP exception thrown: Instance 5ee205ae-99c2-4fe2-8160-e336188072b0 could not be found. Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b7d6cc76-d8a1-4ff4-b022-316e3bee0129 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Request method failure captured: Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 HTTP/1.1 Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BcttderPmzD14SOzevUatQn_f-KHC5OwGIojgRdyaUAc4Q1splEtFnf0Amz--8kn0btqR7qNv-Oau7NZOr9CIrJ1ECpBFaPA389wG3XOEox8RN_ElBs6FWCM-M77RP2f4-NCuQPVbu8Asiz1iIG5mD8gksIoGny2uALegpP_gIpua4 Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 08a954085f8f454698c55faa9351ad6e Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:39:31.858828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_08a954085f8f454698c55faa9351ad6e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 08a954085f8f454698c55faa9351ad6e Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-ServerRescueNegativeTestJSON-450575223-project Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 07e70b1c968443eab469777283b8fb50 Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-ServerRescueNegativeTestJSON-450575223-project Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 5ee205ae-99c2-4fe2-8160-e336188072b0 could not be found. Jul 26 16:39:31.860498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '5ee205ae-99c2-4fe2-8160-e336188072b0'} Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ee205ae-99c2-4fe2-8160-e336188072b0 could not be found. Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:39:31.861272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ee205ae-99c2-4fe2-8160-e336188072b0 could not be found. Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ee205ae-99c2-4fe2-8160-e336188072b0 could not be found. Jul 26 16:39:31.863050 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:39:31.864578 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b7d6cc76-d8a1-4ff4-b022-316e3bee0129 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Returning 404 to user: Instance 5ee205ae-99c2-4fe2-8160-e336188072b0 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:39:31.864578 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b7d6cc76-d8a1-4ff4-b022-316e3bee0129 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0" status: 404 len: 111 microversion: 2.1 time: 0.030417 Jul 26 16:39:31.864578 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 348/713] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:31 2022] GET /compute/v2.1/servers/5ee205ae-99c2-4fe2-8160-e336188072b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:39:31.869903 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d217cb89-3228-4c85-b41c-f5ee1eb4d6a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:31.870390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d217cb89-3228-4c85-b41c-f5ee1eb4d6a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:31.876713 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d217cb89-3228-4c85-b41c-f5ee1eb4d6a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:31.877167 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d217cb89-3228-4c85-b41c-f5ee1eb4d6a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:31.877928 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d217cb89-3228-4c85-b41c-f5ee1eb4d6a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:31.878355 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d217cb89-3228-4c85-b41c-f5ee1eb4d6a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:31.908751 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d217cb89-3228-4c85-b41c-f5ee1eb4d6a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Going to try to terminate instance {{(pid=124821) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:39:32.161251 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ab5c99c1-a314-43ab-a7a1-85e5d052fde8 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:32.161861 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ab5c99c1-a314-43ab-a7a1-85e5d052fde8 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:32.167848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ab5c99c1-a314-43ab-a7a1-85e5d052fde8 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:32.168298 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ab5c99c1-a314-43ab-a7a1-85e5d052fde8 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:32.169103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ab5c99c1-a314-43ab-a7a1-85e5d052fde8 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:32.169538 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ab5c99c1-a314-43ab-a7a1-85e5d052fde8 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:32.226186 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d217cb89-3228-4c85-b41c-f5ee1eb4d6a7 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "DELETE /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 204 len: 0 microversion: 2.1 time: 0.359746 Jul 26 16:39:32.226772 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 366/714] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:39:31 2022] DELETE /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:39:32.235547 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e087c077-af7b-46fc-9255-3205947118a5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:32.236510 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e087c077-af7b-46fc-9255-3205947118a5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:32.243055 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e087c077-af7b-46fc-9255-3205947118a5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:32.243512 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e087c077-af7b-46fc-9255-3205947118a5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:32.244288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e087c077-af7b-46fc-9255-3205947118a5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:32.244747 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e087c077-af7b-46fc-9255-3205947118a5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:32.314670 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ab5c99c1-a314-43ab-a7a1-85e5d052fde8 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:32.322407 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ab5c99c1-a314-43ab-a7a1-85e5d052fde8 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1523 microversion: 2.1 time: 0.165882 Jul 26 16:39:32.322972 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 349/715] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:32 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:32.382399 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e087c077-af7b-46fc-9255-3205947118a5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:32.389883 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e087c077-af7b-46fc-9255-3205947118a5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.158910 Jul 26 16:39:32.390440 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 367/716] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:32 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:33.344465 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0c1454a8-c09a-48d5-a8c3-5586eec5ccb6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:33.344987 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0c1454a8-c09a-48d5-a8c3-5586eec5ccb6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:33.351388 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0c1454a8-c09a-48d5-a8c3-5586eec5ccb6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:33.351838 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0c1454a8-c09a-48d5-a8c3-5586eec5ccb6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:33.352633 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0c1454a8-c09a-48d5-a8c3-5586eec5ccb6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:33.353071 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0c1454a8-c09a-48d5-a8c3-5586eec5ccb6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:33.410740 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f0519912-0dbe-4e50-a153-10318692e99c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:33.411364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f0519912-0dbe-4e50-a153-10318692e99c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:33.417931 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0519912-0dbe-4e50-a153-10318692e99c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:33.418373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0519912-0dbe-4e50-a153-10318692e99c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:33.419123 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0519912-0dbe-4e50-a153-10318692e99c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:33.419750 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0519912-0dbe-4e50-a153-10318692e99c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:33.486464 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0c1454a8-c09a-48d5-a8c3-5586eec5ccb6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:33.493990 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0c1454a8-c09a-48d5-a8c3-5586eec5ccb6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1523 microversion: 2.1 time: 0.153418 Jul 26 16:39:33.494688 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 350/717] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:33 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:33.550039 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f0519912-0dbe-4e50-a153-10318692e99c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:33.557422 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f0519912-0dbe-4e50-a153-10318692e99c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.150448 Jul 26 16:39:33.557973 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 368/718] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:33 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:34.515000 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f5fb0e6d-6867-4b9f-b0c3-ef6a45b1f7c5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:34.515612 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f5fb0e6d-6867-4b9f-b0c3-ef6a45b1f7c5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:34.522157 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f5fb0e6d-6867-4b9f-b0c3-ef6a45b1f7c5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:34.522608 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f5fb0e6d-6867-4b9f-b0c3-ef6a45b1f7c5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:34.523377 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f5fb0e6d-6867-4b9f-b0c3-ef6a45b1f7c5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:34.523820 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f5fb0e6d-6867-4b9f-b0c3-ef6a45b1f7c5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:34.578994 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1d0f2548-89bb-4321-af8b-8f33e71d1c1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:34.579516 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1d0f2548-89bb-4321-af8b-8f33e71d1c1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:34.585806 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d0f2548-89bb-4321-af8b-8f33e71d1c1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:34.586255 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d0f2548-89bb-4321-af8b-8f33e71d1c1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:34.587021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d0f2548-89bb-4321-af8b-8f33e71d1c1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:34.587457 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d0f2548-89bb-4321-af8b-8f33e71d1c1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:34.658828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f5fb0e6d-6867-4b9f-b0c3-ef6a45b1f7c5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:34.667231 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f5fb0e6d-6867-4b9f-b0c3-ef6a45b1f7c5 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1523 microversion: 2.1 time: 0.156068 Jul 26 16:39:34.667893 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 351/719] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:34 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:34.730190 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1d0f2548-89bb-4321-af8b-8f33e71d1c1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:34.738201 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1d0f2548-89bb-4321-af8b-8f33e71d1c1c tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1525 microversion: 2.1 time: 0.163271 Jul 26 16:39:34.738757 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 369/720] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:34 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1525 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:35.689996 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e864dfe0-4ae6-4c67-9577-f89779ff3fbd tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:35.690607 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e864dfe0-4ae6-4c67-9577-f89779ff3fbd tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:35.697543 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e864dfe0-4ae6-4c67-9577-f89779ff3fbd tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:35.698003 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e864dfe0-4ae6-4c67-9577-f89779ff3fbd tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:35.698772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e864dfe0-4ae6-4c67-9577-f89779ff3fbd tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:35.699384 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e864dfe0-4ae6-4c67-9577-f89779ff3fbd tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:35.759099 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-80089850-17ae-4265-a04f-0897f78149d8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:35.759708 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-80089850-17ae-4265-a04f-0897f78149d8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:35.780757 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80089850-17ae-4265-a04f-0897f78149d8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:35.782697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80089850-17ae-4265-a04f-0897f78149d8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:35.783760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80089850-17ae-4265-a04f-0897f78149d8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:35.784552 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80089850-17ae-4265-a04f-0897f78149d8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:35.867071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80089850-17ae-4265-a04f-0897f78149d8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:35.872665 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-80089850-17ae-4265-a04f-0897f78149d8 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1483 microversion: 2.1 time: 0.117347 Jul 26 16:39:35.873794 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 370/721] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:35 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1483 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:35.878652 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-cd1fc77e-ac18-4844-ba2e-eb5400674d92 req-029c9209-d488-42bc-8db1-44b9307770e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad766a1-6214-4f3a-aa55-50ca2baa6b64", "name": "network-vif-deleted", "tag": "16990b57-d241-4bda-9263-5fdbfd1138b4"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:39:35.889554 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-cd1fc77e-ac18-4844-ba2e-eb5400674d92 req-029c9209-d488-42bc-8db1-44b9307770e9 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:35.890407 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-cd1fc77e-ac18-4844-ba2e-eb5400674d92 req-029c9209-d488-42bc-8db1-44b9307770e9 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:35.904893 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-cd1fc77e-ac18-4844-ba2e-eb5400674d92 req-029c9209-d488-42bc-8db1-44b9307770e9 service nova] Creating event network-vif-deleted:16990b57-d241-4bda-9263-5fdbfd1138b4 for instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 on hv-cinder-85104 Jul 26 16:39:35.910997 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-cd1fc77e-ac18-4844-ba2e-eb5400674d92 req-029c9209-d488-42bc-8db1-44b9307770e9 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035517 Jul 26 16:39:35.912187 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 371/722] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:35.938889 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e864dfe0-4ae6-4c67-9577-f89779ff3fbd tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:35.947262 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e864dfe0-4ae6-4c67-9577-f89779ff3fbd tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.261097 Jul 26 16:39:35.947832 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 352/723] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:35 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:36.898715 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:36.899406 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:36.907242 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:36.908180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:36.908754 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:36.908892 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:36.939900 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:36.940345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:36.940816 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lazy-loading 'fault' on Instance uuid fad766a1-6214-4f3a-aa55-50ca2baa6b64 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:39:36.971102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2c9ea377-fdc6-478d-9431-ec932f5968a6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:36.971688 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2c9ea377-fdc6-478d-9431-ec932f5968a6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:36.978083 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2c9ea377-fdc6-478d-9431-ec932f5968a6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:36.978535 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2c9ea377-fdc6-478d-9431-ec932f5968a6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:36.979290 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2c9ea377-fdc6-478d-9431-ec932f5968a6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:36.979951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2c9ea377-fdc6-478d-9431-ec932f5968a6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:36.982026 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:36.990092 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-bb6057ff-1957-43f4-b2f5-b5ef2c7fa2c5 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1316 microversion: 2.1 time: 0.095861 Jul 26 16:39:36.990652 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 372/724] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:36 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1316 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:37.108961 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2c9ea377-fdc6-478d-9431-ec932f5968a6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:37.116248 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2c9ea377-fdc6-478d-9431-ec932f5968a6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.149537 Jul 26 16:39:37.116831 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 353/725] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:36 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:39:38.013745 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:38.014349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:38.022271 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:38.022713 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:38.023520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:38.023952 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:38.059303 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:38.059748 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:38.060192 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lazy-loading 'fault' on Instance uuid fad766a1-6214-4f3a-aa55-50ca2baa6b64 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:39:38.102362 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07e70b1c968443eab469777283b8fb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08a954085f8f454698c55faa9351ad6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:38.112204 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5cd21fcc-f4f4-4132-9bbe-3f02d6b15063 tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 200 len: 1316 microversion: 2.1 time: 0.102924 Jul 26 16:39:38.112881 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 373/726] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:38 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 1316 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:38.138335 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6f23f1e4-86d1-415f-bf5b-1be632383db4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:38.138940 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6f23f1e4-86d1-415f-bf5b-1be632383db4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:38.146127 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6f23f1e4-86d1-415f-bf5b-1be632383db4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:38.146569 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6f23f1e4-86d1-415f-bf5b-1be632383db4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:38.147394 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6f23f1e4-86d1-415f-bf5b-1be632383db4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:38.147822 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6f23f1e4-86d1-415f-bf5b-1be632383db4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:38.294146 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6f23f1e4-86d1-415f-bf5b-1be632383db4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:38.301980 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6f23f1e4-86d1-415f-bf5b-1be632383db4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.168662 Jul 26 16:39:38.302536 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 354/727] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:38 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:39.134112 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1e1dd189-9a92-4dfe-acaf-80aa3d3ad86b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:39.134759 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1e1dd189-9a92-4dfe-acaf-80aa3d3ad86b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] [instance: fad766a1-6214-4f3a-aa55-50ca2baa6b64] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:39.141898 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1e1dd189-9a92-4dfe-acaf-80aa3d3ad86b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:39.142349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1e1dd189-9a92-4dfe-acaf-80aa3d3ad86b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:39.143123 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1e1dd189-9a92-4dfe-acaf-80aa3d3ad86b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:39.143558 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1e1dd189-9a92-4dfe-acaf-80aa3d3ad86b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:39.157060 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-1e1dd189-9a92-4dfe-acaf-80aa3d3ad86b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] HTTP exception thrown: Instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 could not be found. Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1e1dd189-9a92-4dfe-acaf-80aa3d3ad86b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Request method failure captured: Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 HTTP/1.1 Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BcttderPmzD14SOzevUatQn_f-KHC5OwGIojgRdyaUAc4Q1splEtFnf0Amz--8kn0btqR7qNv-Oau7NZOr9CIrJ1ECpBFaPA389wG3XOEox8RN_ElBs6FWCM-M77RP2f4-NCuQPVbu8Asiz1iIG5mD8gksIoGny2uALegpP_gIpua4 Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 08a954085f8f454698c55faa9351ad6e Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:39:39.158718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/08a954085f8f454698c55faa9351ad6e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_08a954085f8f454698c55faa9351ad6e", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 08a954085f8f454698c55faa9351ad6e Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-450575223 Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-ServerRescueNegativeTestJSON-450575223-project Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 07e70b1c968443eab469777283b8fb50 Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-ServerRescueNegativeTestJSON-450575223-project Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 could not be found. Jul 26 16:39:39.162540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': 'fad766a1-6214-4f3a-aa55-50ca2baa6b64'} Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 could not be found. Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:39:39.163263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 could not be found. Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 could not be found. Jul 26 16:39:39.164375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:39:39.165516 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1e1dd189-9a92-4dfe-acaf-80aa3d3ad86b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] Returning 404 to user: Instance fad766a1-6214-4f3a-aa55-50ca2baa6b64 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:39:39.165516 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1e1dd189-9a92-4dfe-acaf-80aa3d3ad86b tempest-ServerRescueNegativeTestJSON-450575223 tempest-ServerRescueNegativeTestJSON-450575223-project] 10.222.0.144 "GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64" status: 404 len: 111 microversion: 2.1 time: 0.029921 Jul 26 16:39:39.165516 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 374/728] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:39 2022] GET /compute/v2.1/servers/fad766a1-6214-4f3a-aa55-50ca2baa6b64 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:39:39.325250 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-89af22df-5e65-4c37-838f-4fa750a7d6e3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:39.325848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-89af22df-5e65-4c37-838f-4fa750a7d6e3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:39.332975 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-89af22df-5e65-4c37-838f-4fa750a7d6e3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:39.333486 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-89af22df-5e65-4c37-838f-4fa750a7d6e3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:39.334251 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-89af22df-5e65-4c37-838f-4fa750a7d6e3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:39.334685 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-89af22df-5e65-4c37-838f-4fa750a7d6e3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:39.467195 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-89af22df-5e65-4c37-838f-4fa750a7d6e3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:39.476055 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-89af22df-5e65-4c37-838f-4fa750a7d6e3 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.154838 Jul 26 16:39:39.476671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 355/729] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:39 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:40.498037 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-54f4dfb3-24d0-4964-a6f7-02ba70444ab4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:40.498642 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-54f4dfb3-24d0-4964-a6f7-02ba70444ab4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:40.509795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-54f4dfb3-24d0-4964-a6f7-02ba70444ab4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:40.509795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-54f4dfb3-24d0-4964-a6f7-02ba70444ab4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:40.509795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-54f4dfb3-24d0-4964-a6f7-02ba70444ab4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:40.509795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-54f4dfb3-24d0-4964-a6f7-02ba70444ab4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:40.514542 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:40.723293 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-54f4dfb3-24d0-4964-a6f7-02ba70444ab4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:40.730855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-54f4dfb3-24d0-4964-a6f7-02ba70444ab4 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.236789 Jul 26 16:39:40.731587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 375/730] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:40 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:41.751707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d925067e-03fa-4f95-90a9-eb125f0e64ea tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:41.752356 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d925067e-03fa-4f95-90a9-eb125f0e64ea tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:41.758991 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d925067e-03fa-4f95-90a9-eb125f0e64ea tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:41.759555 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d925067e-03fa-4f95-90a9-eb125f0e64ea tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:41.760438 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d925067e-03fa-4f95-90a9-eb125f0e64ea tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:41.760880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d925067e-03fa-4f95-90a9-eb125f0e64ea tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:41.909408 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d925067e-03fa-4f95-90a9-eb125f0e64ea tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:41.917428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d925067e-03fa-4f95-90a9-eb125f0e64ea tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.169746 Jul 26 16:39:41.918252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 356/731] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:41 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:42.939480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-31b32ef3-f39d-4516-8f37-41aab14faf71 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:42.940090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-31b32ef3-f39d-4516-8f37-41aab14faf71 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:42.950143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-31b32ef3-f39d-4516-8f37-41aab14faf71 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:42.951374 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-31b32ef3-f39d-4516-8f37-41aab14faf71 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:42.952307 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-31b32ef3-f39d-4516-8f37-41aab14faf71 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:42.952907 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-31b32ef3-f39d-4516-8f37-41aab14faf71 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:43.112846 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-31b32ef3-f39d-4516-8f37-41aab14faf71 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:43.120681 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-31b32ef3-f39d-4516-8f37-41aab14faf71 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.185431 Jul 26 16:39:43.121325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 376/732] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:42 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:44.142447 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-158ddec6-2c86-4670-8254-3fccf923925c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:44.143091 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-158ddec6-2c86-4670-8254-3fccf923925c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:44.149698 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-158ddec6-2c86-4670-8254-3fccf923925c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:44.150148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-158ddec6-2c86-4670-8254-3fccf923925c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:44.150909 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-158ddec6-2c86-4670-8254-3fccf923925c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:44.151613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-158ddec6-2c86-4670-8254-3fccf923925c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:44.541444 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-158ddec6-2c86-4670-8254-3fccf923925c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:44.549008 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-158ddec6-2c86-4670-8254-3fccf923925c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.410846 Jul 26 16:39:44.549570 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 357/733] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:44 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:45.569086 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a9d05709-fa1e-4ff4-b84d-deba60283ea6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:45.569697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a9d05709-fa1e-4ff4-b84d-deba60283ea6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:45.576221 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9d05709-fa1e-4ff4-b84d-deba60283ea6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:45.576699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9d05709-fa1e-4ff4-b84d-deba60283ea6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:45.577489 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9d05709-fa1e-4ff4-b84d-deba60283ea6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:45.577929 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9d05709-fa1e-4ff4-b84d-deba60283ea6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:45.710796 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a9d05709-fa1e-4ff4-b84d-deba60283ea6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:45.718738 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a9d05709-fa1e-4ff4-b84d-deba60283ea6 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.153376 Jul 26 16:39:45.719897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 377/734] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:45 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:46.741306 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b6ba6f1d-c616-4945-b209-3143e1255aac tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:46.741916 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b6ba6f1d-c616-4945-b209-3143e1255aac tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:46.748878 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b6ba6f1d-c616-4945-b209-3143e1255aac tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:46.749245 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b6ba6f1d-c616-4945-b209-3143e1255aac tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:46.750027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b6ba6f1d-c616-4945-b209-3143e1255aac tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:46.750461 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b6ba6f1d-c616-4945-b209-3143e1255aac tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:46.883778 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b6ba6f1d-c616-4945-b209-3143e1255aac tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:46.891872 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b6ba6f1d-c616-4945-b209-3143e1255aac tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.153897 Jul 26 16:39:46.892448 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 358/735] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:46 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:47.913173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c97a9a11-0a6c-47bd-b257-ab785f8b54bf tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:47.913772 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c97a9a11-0a6c-47bd-b257-ab785f8b54bf tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:47.919897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c97a9a11-0a6c-47bd-b257-ab785f8b54bf tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:47.920339 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c97a9a11-0a6c-47bd-b257-ab785f8b54bf tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:47.921128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c97a9a11-0a6c-47bd-b257-ab785f8b54bf tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:47.921553 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c97a9a11-0a6c-47bd-b257-ab785f8b54bf tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:47.939152 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-03d7a858-c033-4af2-a056-45169f20424f req-65affca1-0e9f-4059-897c-727c6855fc66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976970b3-530e-4bc0-a609-bc3d8ac750a8", "name": "network-vif-plugged", "status": "completed", "tag": "e562fcc8-f654-4575-a60e-9fafbe61bfee"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:39:47.949769 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-03d7a858-c033-4af2-a056-45169f20424f req-65affca1-0e9f-4059-897c-727c6855fc66 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:47.950218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-03d7a858-c033-4af2-a056-45169f20424f req-65affca1-0e9f-4059-897c-727c6855fc66 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:47.962319 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-03d7a858-c033-4af2-a056-45169f20424f req-65affca1-0e9f-4059-897c-727c6855fc66 service nova] Creating event network-vif-plugged:e562fcc8-f654-4575-a60e-9fafbe61bfee for instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 on hv-cinder-85104 Jul 26 16:39:47.967887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-03d7a858-c033-4af2-a056-45169f20424f req-65affca1-0e9f-4059-897c-727c6855fc66 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032889 Jul 26 16:39:47.969659 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 359/736] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:39:48.010773 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-955d2d34-be6f-4a43-af5a-352da8dc2edb tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b6c0c6040>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:48.069396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-955d2d34-be6f-4a43-af5a-352da8dc2edb tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/c7dec540-c490-4853-8730-87288eef8277" status: 200 len: 350 microversion: 2.1 time: 0.062001 Jul 26 16:39:48.070090 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 360/737] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:39:48 2022] GET /compute/v2.1/os-volumes/c7dec540-c490-4853-8730-87288eef8277 => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:39:48.079880 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c97a9a11-0a6c-47bd-b257-ab785f8b54bf tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:48.089083 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c97a9a11-0a6c-47bd-b257-ab785f8b54bf tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.179638 Jul 26 16:39:48.089734 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 378/738] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:47 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:49.111496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9ca450a1-709f-4df1-82ae-b39ff408186a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:49.112227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9ca450a1-709f-4df1-82ae-b39ff408186a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:49.118437 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9ca450a1-709f-4df1-82ae-b39ff408186a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:49.118894 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9ca450a1-709f-4df1-82ae-b39ff408186a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:49.119683 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9ca450a1-709f-4df1-82ae-b39ff408186a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:49.120144 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9ca450a1-709f-4df1-82ae-b39ff408186a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:49.252786 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9ca450a1-709f-4df1-82ae-b39ff408186a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:49.260247 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9ca450a1-709f-4df1-82ae-b39ff408186a tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1579 microversion: 2.1 time: 0.153717 Jul 26 16:39:49.260837 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 361/739] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:49 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:50.281352 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f5235168-963a-4efe-95b3-17c810507714 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:50.282531 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f5235168-963a-4efe-95b3-17c810507714 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:50.288652 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f5235168-963a-4efe-95b3-17c810507714 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:50.289092 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f5235168-963a-4efe-95b3-17c810507714 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:50.289839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f5235168-963a-4efe-95b3-17c810507714 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:50.290264 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f5235168-963a-4efe-95b3-17c810507714 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:50.426555 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f5235168-963a-4efe-95b3-17c810507714 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:50.434266 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f5235168-963a-4efe-95b3-17c810507714 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1566 microversion: 2.1 time: 0.156764 Jul 26 16:39:50.434837 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 379/740] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:39:50 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:50.920244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f3f87e40-27c7-4d2d-a2f5-7f7948263a1b tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b6c201c10>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:50.965682 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f3f87e40-27c7-4d2d-a2f5-7f7948263a1b tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/c1bef7f7-78c9-46b5-8938-b4f7cad4d39d" status: 200 len: 351 microversion: 2.1 time: 0.049114 Jul 26 16:39:50.966242 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 362/741] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:39:50 2022] GET /compute/v2.1/os-volumes/c1bef7f7-78c9-46b5-8938-b4f7cad4d39d => generated 351 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:53.682981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a09dcf4f-137a-4cbc-ba9e-5aafd237f490 tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b6c17ec10>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:53.729378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a09dcf4f-137a-4cbc-ba9e-5aafd237f490 tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/fa42cabe-f66b-473f-9b87-e61ce4cd7211" status: 200 len: 350 microversion: 2.1 time: 0.050088 Jul 26 16:39:53.729940 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 380/742] 10.222.0.144 () {58 vars in 1250 bytes} [Tue Jul 26 16:39:53 2022] GET /compute/v2.1/os-volumes/fa42cabe-f66b-473f-9b87-e61ce4cd7211 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:53.743175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-69483995-6bf3-4830-891c-46279dd3ee02 tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b677e6820>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:53.827061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-69483995-6bf3-4830-891c-46279dd3ee02 tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088106 Jul 26 16:39:53.827620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 363/743] 10.222.0.144 () {58 vars in 1139 bytes} [Tue Jul 26 16:39:53 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:53.841209 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7ee5538b-f057-4dea-80b9-f1fa55072038 tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b6c202160>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:53.925508 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7ee5538b-f057-4dea-80b9-f1fa55072038 tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087934 Jul 26 16:39:53.926072 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 381/744] 10.222.0.144 () {58 vars in 1154 bytes} [Tue Jul 26 16:39:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:53.939737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bc3cc162-c38a-4d54-a97f-6814cfccfa6b tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b6c113dc0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:54.019442 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bc3cc162-c38a-4d54-a97f-6814cfccfa6b tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.084000 Jul 26 16:39:54.020016 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 364/745] 10.222.0.144 () {58 vars in 1139 bytes} [Tue Jul 26 16:39:53 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:54.033188 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-33ab89d7-eb9f-4bc7-b436-18507d3d6faf tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b6c0c50d0>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:54.113610 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-33ab89d7-eb9f-4bc7-b436-18507d3d6faf tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084592 Jul 26 16:39:54.114214 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 382/746] 10.222.0.144 () {58 vars in 1172 bytes} [Tue Jul 26 16:39:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:54.127806 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1eb4d1a4-f65f-4e74-bd97-e9124259b582 tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b6c264ca0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:54.215668 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1eb4d1a4-f65f-4e74-bd97-e9124259b582 tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.091576 Jul 26 16:39:54.216271 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 365/747] 10.222.0.144 () {58 vars in 1175 bytes} [Tue Jul 26 16:39:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:39:54.230157 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b4349599-d035-4f82-9333-8dd009227dad tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b6c175040>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:54.465083 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b4349599-d035-4f82-9333-8dd009227dad tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.238452 Jul 26 16:39:54.465742 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 383/748] 10.222.0.144 () {58 vars in 1160 bytes} [Tue Jul 26 16:39:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:54.479182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-99a21f75-6147-4b01-a470-813c3545e5bf tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b6c119a60>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:54.565396 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-99a21f75-6147-4b01-a470-813c3545e5bf tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089848 Jul 26 16:39:54.565960 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 384/749] 10.222.0.144 () {58 vars in 1193 bytes} [Tue Jul 26 16:39:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:39:54.579379 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0e67c254-bf86-4799-9e20-382c5e431178 tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] Calling method '.version_select at 0x7f4b6c0d6670>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:54.607889 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fdc7f108-308b-4bb7-8ddc-1327032de50e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:54.611959 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fdc7f108-308b-4bb7-8ddc-1327032de50e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:54.615002 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fdc7f108-308b-4bb7-8ddc-1327032de50e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:54.615452 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fdc7f108-308b-4bb7-8ddc-1327032de50e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:54.616212 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fdc7f108-308b-4bb7-8ddc-1327032de50e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:54.616661 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fdc7f108-308b-4bb7-8ddc-1327032de50e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:54.620518 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:54.645265 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fdc7f108-308b-4bb7-8ddc-1327032de50e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments/0fca2ad1-5c52-42a9-87be-30dda24f9902" status: 200 len: 194 microversion: 2.20 time: 0.209180 Jul 26 16:39:54.645785 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 366/750] 10.222.0.144 () {60 vars in 1459 bytes} [Tue Jul 26 16:39:54 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments/0fca2ad1-5c52-42a9-87be-30dda24f9902 => generated 194 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 16:39:54.662656 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0e67c254-bf86-4799-9e20-382c5e431178 tempest-VolumesTestJSON-1122996865 tempest-VolumesTestJSON-1122996865-project] 10.222.0.144 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087437 Jul 26 16:39:54.663371 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 385/751] 10.222.0.144 () {58 vars in 1160 bytes} [Tue Jul 26 16:39:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:54.715091 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4f99611f-e1cd-4e82-95db-6fbf52bc5f9d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:54.715587 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4f99611f-e1cd-4e82-95db-6fbf52bc5f9d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:54.722542 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4f99611f-e1cd-4e82-95db-6fbf52bc5f9d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:54.722995 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4f99611f-e1cd-4e82-95db-6fbf52bc5f9d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:54.723759 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4f99611f-e1cd-4e82-95db-6fbf52bc5f9d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:54.724194 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4f99611f-e1cd-4e82-95db-6fbf52bc5f9d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:54.801965 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-4f99611f-e1cd-4e82-95db-6fbf52bc5f9d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lazy-loading 'services' on Instance uuid d182cbe3-dff4-482c-a901-f084fc7b0077 {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:39:55.105100 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4f99611f-e1cd-4e82-95db-6fbf52bc5f9d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "DELETE /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments/0fca2ad1-5c52-42a9-87be-30dda24f9902" status: 202 len: 0 microversion: 2.20 time: 0.394086 Jul 26 16:39:55.105731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 367/752] 10.222.0.144 () {60 vars in 1462 bytes} [Tue Jul 26 16:39:54 2022] DELETE /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments/0fca2ad1-5c52-42a9-87be-30dda24f9902 => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:39:55.115575 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2abecda5-5ece-4291-9896-658c5965d4e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:55.118093 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2abecda5-5ece-4291-9896-658c5965d4e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:55.121071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:55.124578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2abecda5-5ece-4291-9896-658c5965d4e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:55.125035 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2abecda5-5ece-4291-9896-658c5965d4e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:55.126431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2abecda5-5ece-4291-9896-658c5965d4e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:55.126866 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2abecda5-5ece-4291-9896-658c5965d4e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:55.157716 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2abecda5-5ece-4291-9896-658c5965d4e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046823 Jul 26 16:39:55.158277 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 386/753] 10.222.0.144 () {60 vars in 1348 bytes} [Tue Jul 26 16:39:55 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 26 16:39:56.171670 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ceed8ef9-ee67-4a52-aa8c-cbffe44a65d1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:56.173980 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ceed8ef9-ee67-4a52-aa8c-cbffe44a65d1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:56.175839 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:39:56.180935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ceed8ef9-ee67-4a52-aa8c-cbffe44a65d1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:56.181374 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ceed8ef9-ee67-4a52-aa8c-cbffe44a65d1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:56.182131 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ceed8ef9-ee67-4a52-aa8c-cbffe44a65d1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:56.182557 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ceed8ef9-ee67-4a52-aa8c-cbffe44a65d1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:56.211449 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ceed8ef9-ee67-4a52-aa8c-cbffe44a65d1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044917 Jul 26 16:39:56.212001 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 368/754] 10.222.0.144 () {60 vars in 1348 bytes} [Tue Jul 26 16:39:56 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:39:57.224849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8313f1be-b647-44fb-87a6-fe52b8ebe31a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:57.226879 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8313f1be-b647-44fb-87a6-fe52b8ebe31a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:57.233535 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8313f1be-b647-44fb-87a6-fe52b8ebe31a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:57.233986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8313f1be-b647-44fb-87a6-fe52b8ebe31a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:57.234740 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8313f1be-b647-44fb-87a6-fe52b8ebe31a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:57.235803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8313f1be-b647-44fb-87a6-fe52b8ebe31a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:57.263502 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8313f1be-b647-44fb-87a6-fe52b8ebe31a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043636 Jul 26 16:39:57.264041 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 387/755] 10.222.0.144 () {60 vars in 1348 bytes} [Tue Jul 26 16:39:57 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:39:57.324528 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-000fdb94-71e1-49d4-8ed8-8dcef9d978dd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:57.325142 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-000fdb94-71e1-49d4-8ed8-8dcef9d978dd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:57.332190 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-000fdb94-71e1-49d4-8ed8-8dcef9d978dd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:57.332653 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-000fdb94-71e1-49d4-8ed8-8dcef9d978dd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:57.333411 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-000fdb94-71e1-49d4-8ed8-8dcef9d978dd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:57.333838 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-000fdb94-71e1-49d4-8ed8-8dcef9d978dd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:57.359364 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-000fdb94-71e1-49d4-8ed8-8dcef9d978dd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:39:57.722371 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-000fdb94-71e1-49d4-8ed8-8dcef9d978dd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "DELETE /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 204 len: 0 microversion: 2.20 time: 0.401727 Jul 26 16:39:57.722964 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 369/756] 10.222.0.144 () {60 vars in 1285 bytes} [Tue Jul 26 16:39:57 2022] DELETE /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 16:39:57.731583 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e9d53430-bc12-4c8a-9ae1-983e656516d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:57.732189 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e9d53430-bc12-4c8a-9ae1-983e656516d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:57.738504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e9d53430-bc12-4c8a-9ae1-983e656516d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:57.738951 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e9d53430-bc12-4c8a-9ae1-983e656516d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:57.739704 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e9d53430-bc12-4c8a-9ae1-983e656516d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:57.740132 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e9d53430-bc12-4c8a-9ae1-983e656516d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:57.878320 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e9d53430-bc12-4c8a-9ae1-983e656516d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:57.886436 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e9d53430-bc12-4c8a-9ae1-983e656516d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:57.887962 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e9d53430-bc12-4c8a-9ae1-983e656516d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:57.889184 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e9d53430-bc12-4c8a-9ae1-983e656516d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.161746 Jul 26 16:39:57.889754 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 388/757] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:39:57 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:39:58.918417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fd07a66b-c11e-43c3-8291-ecc69568f3a9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:39:58.919513 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fd07a66b-c11e-43c3-8291-ecc69568f3a9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:39:58.925918 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fd07a66b-c11e-43c3-8291-ecc69568f3a9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:58.926532 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fd07a66b-c11e-43c3-8291-ecc69568f3a9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:58.927313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fd07a66b-c11e-43c3-8291-ecc69568f3a9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:39:58.927757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fd07a66b-c11e-43c3-8291-ecc69568f3a9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:39:59.060906 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fd07a66b-c11e-43c3-8291-ecc69568f3a9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:59.070066 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fd07a66b-c11e-43c3-8291-ecc69568f3a9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:59.071565 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fd07a66b-c11e-43c3-8291-ecc69568f3a9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:39:59.072752 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fd07a66b-c11e-43c3-8291-ecc69568f3a9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.158818 Jul 26 16:39:59.073312 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 370/758] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:39:58 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:00.095730 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-66dd45bf-ed3f-4a14-a9ca-0661543b0bb0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:00.099744 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-66dd45bf-ed3f-4a14-a9ca-0661543b0bb0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:00.103364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-66dd45bf-ed3f-4a14-a9ca-0661543b0bb0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:00.103873 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-66dd45bf-ed3f-4a14-a9ca-0661543b0bb0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:00.104935 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-66dd45bf-ed3f-4a14-a9ca-0661543b0bb0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:00.105373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-66dd45bf-ed3f-4a14-a9ca-0661543b0bb0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:00.345564 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-66dd45bf-ed3f-4a14-a9ca-0661543b0bb0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:00.354255 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-66dd45bf-ed3f-4a14-a9ca-0661543b0bb0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:00.355868 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-66dd45bf-ed3f-4a14-a9ca-0661543b0bb0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:00.357063 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-66dd45bf-ed3f-4a14-a9ca-0661543b0bb0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1726 microversion: 2.20 time: 0.265196 Jul 26 16:40:00.358919 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 389/759] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:00 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1726 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:01.027239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e4cd47d1-372b-4d29-9707-eda5a4d5e712 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:01.027239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e4cd47d1-372b-4d29-9707-eda5a4d5e712 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:01.031766 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e4cd47d1-372b-4d29-9707-eda5a4d5e712 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:01.032904 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e4cd47d1-372b-4d29-9707-eda5a4d5e712 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:01.033680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e4cd47d1-372b-4d29-9707-eda5a4d5e712 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:01.034234 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e4cd47d1-372b-4d29-9707-eda5a4d5e712 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:01.067503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e4cd47d1-372b-4d29-9707-eda5a4d5e712 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051686 Jul 26 16:40:01.073827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 371/760] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:40:01 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 16:40:01.124616 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-624464a4-1770-401d-b629-a0b1a852de70 req-bd030730-9a9d-439b-82ec-2916408d7ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d182cbe3-dff4-482c-a901-f084fc7b0077", "name": "network-vif-deleted", "tag": "7f871a00-9630-48c9-845a-ddb06fb9a2df"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:01.140165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-624464a4-1770-401d-b629-a0b1a852de70 req-bd030730-9a9d-439b-82ec-2916408d7ffc service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:01.140800 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f3d1ba24-1b6c-4c41-a275-ed1f66afae5d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:01.141093 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-624464a4-1770-401d-b629-a0b1a852de70 req-bd030730-9a9d-439b-82ec-2916408d7ffc service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:01.142199 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f3d1ba24-1b6c-4c41-a275-ed1f66afae5d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:01.148857 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f3d1ba24-1b6c-4c41-a275-ed1f66afae5d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:01.149571 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f3d1ba24-1b6c-4c41-a275-ed1f66afae5d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:01.150888 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f3d1ba24-1b6c-4c41-a275-ed1f66afae5d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:01.151497 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f3d1ba24-1b6c-4c41-a275-ed1f66afae5d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:01.158412 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-624464a4-1770-401d-b629-a0b1a852de70 req-bd030730-9a9d-439b-82ec-2916408d7ffc service nova] Creating event network-vif-deleted:7f871a00-9630-48c9-845a-ddb06fb9a2df for instance d182cbe3-dff4-482c-a901-f084fc7b0077 on hv-cinder-85104 Jul 26 16:40:01.171344 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-624464a4-1770-401d-b629-a0b1a852de70 req-bd030730-9a9d-439b-82ec-2916408d7ffc service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050490 Jul 26 16:40:01.181771 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 390/761] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:40:01.193867 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f3d1ba24-1b6c-4c41-a275-ed1f66afae5d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:40:01.383220 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d21dc613-77b5-4645-852e-889d059ab9e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:01.384715 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d21dc613-77b5-4645-852e-889d059ab9e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:01.392013 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d21dc613-77b5-4645-852e-889d059ab9e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:01.395281 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d21dc613-77b5-4645-852e-889d059ab9e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:01.395281 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d21dc613-77b5-4645-852e-889d059ab9e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:01.395281 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d21dc613-77b5-4645-852e-889d059ab9e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:01.460544 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d21dc613-77b5-4645-852e-889d059ab9e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:01.468893 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d21dc613-77b5-4645-852e-889d059ab9e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:01.475023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d21dc613-77b5-4645-852e-889d059ab9e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:01.475023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d21dc613-77b5-4645-852e-889d059ab9e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1370 microversion: 2.20 time: 0.094837 Jul 26 16:40:01.475023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 391/762] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:01 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1370 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:01.567116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f3d1ba24-1b6c-4c41-a275-ed1f66afae5d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "DELETE /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 204 len: 0 microversion: 2.1 time: 0.429826 Jul 26 16:40:01.568246 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 372/763] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:40:01 2022] DELETE /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 16:40:01.583154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8d7a4aea-092f-47a6-a873-4f81ff34c9ff tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:01.583936 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8d7a4aea-092f-47a6-a873-4f81ff34c9ff tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:01.590657 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d7a4aea-092f-47a6-a873-4f81ff34c9ff tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:01.591321 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d7a4aea-092f-47a6-a873-4f81ff34c9ff tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:01.592215 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d7a4aea-092f-47a6-a873-4f81ff34c9ff tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:01.593163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d7a4aea-092f-47a6-a873-4f81ff34c9ff tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:01.738152 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8d7a4aea-092f-47a6-a873-4f81ff34c9ff tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:01.745944 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8d7a4aea-092f-47a6-a873-4f81ff34c9ff tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1676 microversion: 2.1 time: 0.166862 Jul 26 16:40:01.746665 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 392/764] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:01 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:02.495620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:02.496380 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:02.503363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:02.503817 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:02.504615 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:02.505049 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:02.536753 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:02.537203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:02.537653 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lazy-loading 'fault' on Instance uuid d182cbe3-dff4-482c-a901-f084fc7b0077 {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:40:02.578800 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:02.587258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:02.588789 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:02.589923 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3dc4b841-b763-4ba6-b63b-e9f639c7c6e5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 200 len: 1375 microversion: 2.20 time: 0.098540 Jul 26 16:40:02.590480 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 373/765] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:02 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 1375 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:40:02.767347 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9f57f94e-0ebe-4a00-97cc-5b117f4b2857 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:02.767874 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9f57f94e-0ebe-4a00-97cc-5b117f4b2857 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:02.774334 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9f57f94e-0ebe-4a00-97cc-5b117f4b2857 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:02.774781 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9f57f94e-0ebe-4a00-97cc-5b117f4b2857 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:02.775538 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9f57f94e-0ebe-4a00-97cc-5b117f4b2857 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:02.775965 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9f57f94e-0ebe-4a00-97cc-5b117f4b2857 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:02.910551 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9f57f94e-0ebe-4a00-97cc-5b117f4b2857 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:02.918060 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9f57f94e-0ebe-4a00-97cc-5b117f4b2857 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1676 microversion: 2.1 time: 0.154806 Jul 26 16:40:02.918654 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 393/766] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:02 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:03.613159 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ee93e806-0350-43d4-9aca-090775a11676 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:03.613702 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ee93e806-0350-43d4-9aca-090775a11676 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:03.620043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ee93e806-0350-43d4-9aca-090775a11676 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:03.620527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ee93e806-0350-43d4-9aca-090775a11676 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:03.621330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ee93e806-0350-43d4-9aca-090775a11676 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:03.621759 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ee93e806-0350-43d4-9aca-090775a11676 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:03.636010 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-ee93e806-0350-43d4-9aca-090775a11676 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] HTTP exception thrown: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ee93e806-0350-43d4-9aca-090775a11676 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Request method failure captured: Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 HTTP/1.1 Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bec7vAywfGhryLpnnhkvmFf-2F1cB1wUOtlUI8gy6ZMMl7Pxch5VXFpdLebg6ifqDw22fw_KOyucGkiZcFCzrysqCKpS5c5EehPlV3n_74uZusBYzHxeL3NfKwNAiJOOx_Tdoornb-437tvf4_zcjzD4NQlYiE7uzLhKa0VLb4tQiA Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:40:03.637757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_f6a8f13fe22741d6843f193a0a959e57", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 09de5ea60b9943adacc765b5ecdccb71 Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:40:03.639616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': 'd182cbe3-dff4-482c-a901-f084fc7b0077'} Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:40:03.640606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:40:03.642396 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:40:03.643999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ee93e806-0350-43d4-9aca-090775a11676 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Returning 404 to user: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:40:03.643999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ee93e806-0350-43d4-9aca-090775a11676 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 404 len: 111 microversion: 2.20 time: 0.030611 Jul 26 16:40:03.643999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 374/767] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:03 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 26 16:40:03.653289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b197d16f-6e76-44d5-a051-525c12cd9ff7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '.version_select at 0x7f4b6c0c50d0>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:03.744939 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b197d16f-6e76-44d5-a051-525c12cd9ff7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392021124" status: 204 len: 0 microversion: 2.20 time: 0.095680 Jul 26 16:40:03.745825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 394/768] 10.222.0.144 () {60 vars in 1267 bytes} [Tue Jul 26 16:40:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392021124 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 16:40:03.939239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8b835608-e80e-47ce-89f4-b32e08f24cbf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:03.940080 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8b835608-e80e-47ce-89f4-b32e08f24cbf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:03.946297 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8b835608-e80e-47ce-89f4-b32e08f24cbf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:03.946857 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8b835608-e80e-47ce-89f4-b32e08f24cbf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:03.947716 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8b835608-e80e-47ce-89f4-b32e08f24cbf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:03.948252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8b835608-e80e-47ce-89f4-b32e08f24cbf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:04.013597 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8b835608-e80e-47ce-89f4-b32e08f24cbf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:04.021912 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8b835608-e80e-47ce-89f4-b32e08f24cbf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1609 microversion: 2.1 time: 0.086522 Jul 26 16:40:04.024662 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 375/769] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:03 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1609 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:04.146501 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-0ed38806-5b9d-4e49-a743-45c9dd17fc4f req-dfa51ef7-628f-48c6-a88d-f1fc9762c740 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a999303-ed3e-4e86-b4f3-4d04e1aec162", "name": "network-vif-deleted", "tag": "bf8c65dd-f0b9-4fd7-9a7b-bffc6f90dd01"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:04.160606 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-0ed38806-5b9d-4e49-a743-45c9dd17fc4f req-dfa51ef7-628f-48c6-a88d-f1fc9762c740 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:04.161438 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-0ed38806-5b9d-4e49-a743-45c9dd17fc4f req-dfa51ef7-628f-48c6-a88d-f1fc9762c740 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:04.173760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-0ed38806-5b9d-4e49-a743-45c9dd17fc4f req-dfa51ef7-628f-48c6-a88d-f1fc9762c740 service nova] Creating event network-vif-deleted:bf8c65dd-f0b9-4fd7-9a7b-bffc6f90dd01 for instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 on hv-cinder-85104 Jul 26 16:40:04.179398 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-0ed38806-5b9d-4e49-a743-45c9dd17fc4f req-dfa51ef7-628f-48c6-a88d-f1fc9762c740 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038646 Jul 26 16:40:04.180509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 395/770] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:40:04.855332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f51a9133-4fa6-4eb5-8092-135b1d89273b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Action: 'create', calling method: .version_select at 0x7f4b677df040>, body: {"keypair": {"name": "tempest-keypair-1772132431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFhtN4L6VfV7hsjNxqYM8Y81SHKXUSnTULkLcZ8aMTp6+sKFWKK5+7euj8IrLkPCL6o0M2qx1hsZaz+azHgW6jXznP6chaV15ygDTtYKIMy6IK6skti1ShjAn2khhICbQ=="}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:04.870979 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-f51a9133-4fa6-4eb5-8092-135b1d89273b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Getting quotas for project f6a8f13fe22741d6843f193a0a959e57. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:40:04.874942 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-f51a9133-4fa6-4eb5-8092-135b1d89273b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Getting quotas for user 09de5ea60b9943adacc765b5ecdccb71 and project f6a8f13fe22741d6843f193a0a959e57. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:40:04.998939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f51a9133-4fa6-4eb5-8092-135b1d89273b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.147522 Jul 26 16:40:04.999647 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 376/771] 10.222.0.144 () {62 vars in 1205 bytes} [Tue Jul 26 16:40:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 26 16:40:05.044674 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:05.045366 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:05.052779 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:05.053241 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:05.053999 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:05.054425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:05.087842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:05.088280 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:05.088751 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lazy-loading 'fault' on Instance uuid 4a999303-ed3e-4e86-b4f3-4d04e1aec162 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:40:05.132162 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:05.139781 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9c142d82-7a6a-4dca-98a2-9ad1322562bd tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 200 len: 1331 microversion: 2.1 time: 0.099313 Jul 26 16:40:05.140413 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 396/772] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:05 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:06.161839 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-52a0f0e7-799c-4db1-bd71-33756ca302d0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:06.162456 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-52a0f0e7-799c-4db1-bd71-33756ca302d0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:06.169171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-52a0f0e7-799c-4db1-bd71-33756ca302d0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:06.170253 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-52a0f0e7-799c-4db1-bd71-33756ca302d0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:06.170364 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-52a0f0e7-799c-4db1-bd71-33756ca302d0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:06.170794 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-52a0f0e7-799c-4db1-bd71-33756ca302d0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:06.185805 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-52a0f0e7-799c-4db1-bd71-33756ca302d0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] HTTP exception thrown: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-52a0f0e7-799c-4db1-bd71-33756ca302d0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Request method failure captured: Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 HTTP/1.1 Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcv7-GmZsMqMa81asrWjNYj6jdoX11buhSIm9RcdQ2qbZIRmMCqA0pySeJmN_qiSq7OFWU2YFF_5MAPPnleNIfLISNZ-HPfnJv-puElKaV-C2FD4oydCp3QeaDLUc2O4BRAkA6mJZuwdW5LEm4OLNNoUktqP-zeYvzl2cWuGeMLee0 Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:40:06.187342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/4088561009754a839604e3798787d8b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_4088561009754a839604e3798787d8b9", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 1b9d76409f834b478981c0bbc0c3d4b6 Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:40:06.189481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '4a999303-ed3e-4e86-b4f3-4d04e1aec162'} Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:40:06.190318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:40:06.191707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:40:06.192986 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-52a0f0e7-799c-4db1-bd71-33756ca302d0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Returning 404 to user: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:40:06.192986 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-52a0f0e7-799c-4db1-bd71-33756ca302d0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 404 len: 111 microversion: 2.1 time: 0.031941 Jul 26 16:40:06.192986 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 377/773] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:06 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:40:06.198383 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b74c4cb1-d287-428b-93bc-dc94cd6d0d3d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '.version_select at 0x7f4b6c10f1f0>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:06.290057 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b74c4cb1-d287-428b-93bc-dc94cd6d0d3d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-156862295" status: 202 len: 0 microversion: 2.1 time: 0.095425 Jul 26 16:40:06.290640 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 397/774] 10.222.0.144 () {58 vars in 1223 bytes} [Tue Jul 26 16:40:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-156862295 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:40:07.145672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-de4361ad-26a5-4af0-8602-3d59faa90803 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'create', calling method: .version_select at 0x7f4b677903a0>, body: {"keypair": {"name": "tempest-keypair-1408676385", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRbwMCOW+hSfAK7AOv7XMaEPSxoxY3x50Agdy5Or8L9fqcT/6HihuC9HLsGxNHaeMR6qxQjDiyrYLvSs7tsTdVBHVqwS3HYpu8iZ9bl2xY8fGLXDCyn0FUwmsbbypKz0Q=="}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:07.162919 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-de4361ad-26a5-4af0-8602-3d59faa90803 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Getting quotas for project 4088561009754a839604e3798787d8b9. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:40:07.169043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-de4361ad-26a5-4af0-8602-3d59faa90803 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Getting quotas for user 1b9d76409f834b478981c0bbc0c3d4b6 and project 4088561009754a839604e3798787d8b9. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:40:07.273649 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-de4361ad-26a5-4af0-8602-3d59faa90803 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132248 Jul 26 16:40:07.274480 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 378/775] 10.222.0.144 () {60 vars in 1164 bytes} [Tue Jul 26 16:40:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:40:07.859170 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-635940496", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "862673cc-ea89-444e-b2bd-e75d18a6efab"}], "security_groups": [{"name": "tempest-securitygroup--1706014418"}], "key_name": "tempest-keypair-1772132431", "user_data": "}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:07.969167 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] validate_networks() for [('862673cc-ea89-444e-b2bd-e75d18a6efab', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:40:08.362576 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:40:08.362999 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:40:08.363500 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:40:08.363931 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:40:08.364340 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:40:08.373514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:08.374018 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:08.374762 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:08.375197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:08.393123 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Getting quotas for project f6a8f13fe22741d6843f193a0a959e57. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:40:08.397653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Getting quotas for user 09de5ea60b9943adacc765b5ecdccb71 and project f6a8f13fe22741d6843f193a0a959e57. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:40:08.408847 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:40:08.411097 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:40:08.551520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8d372c8e-15e5-4f59-baf5-19e9be8a8bef tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 0.697254 Jul 26 16:40:08.552157 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 398/776] 10.222.0.144 () {62 vars in 1193 bytes} [Tue Jul 26 16:40:07 2022] POST /compute/v2.1/servers => generated 404 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 26 16:40:08.563948 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-96321a5e-b64e-4a3e-a58a-8ee1fb73b14a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:08.564927 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-96321a5e-b64e-4a3e-a58a-8ee1fb73b14a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:08.633248 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-96321a5e-b64e-4a3e-a58a-8ee1fb73b14a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:08.640967 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-96321a5e-b64e-4a3e-a58a-8ee1fb73b14a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:08.656132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-96321a5e-b64e-4a3e-a58a-8ee1fb73b14a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:08.656132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-96321a5e-b64e-4a3e-a58a-8ee1fb73b14a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1285 microversion: 2.20 time: 0.085081 Jul 26 16:40:08.656132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 379/777] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:08 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:09.667750 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e960cff5-ce6e-4758-9fed-ea87bd82061d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:09.668447 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e960cff5-ce6e-4758-9fed-ea87bd82061d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:09.675764 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e960cff5-ce6e-4758-9fed-ea87bd82061d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:09.676222 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e960cff5-ce6e-4758-9fed-ea87bd82061d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:09.677019 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e960cff5-ce6e-4758-9fed-ea87bd82061d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:09.677451 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e960cff5-ce6e-4758-9fed-ea87bd82061d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:09.743001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e960cff5-ce6e-4758-9fed-ea87bd82061d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:09.751164 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e960cff5-ce6e-4758-9fed-ea87bd82061d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:09.752954 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e960cff5-ce6e-4758-9fed-ea87bd82061d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:09.754052 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e960cff5-ce6e-4758-9fed-ea87bd82061d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1289 microversion: 2.20 time: 0.090796 Jul 26 16:40:09.754611 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 399/778] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:09 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:09.969284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-828993088", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "064214c0-586f-4d9b-9abf-5c6b26d0c406"}], "security_groups": [{"name": "tempest-securitygroup--258828402"}], "key_name": "tempest-keypair-1408676385", "user_data": "}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:10.073146 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.network.neutron [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] validate_networks() for [('064214c0-586f-4d9b-9abf-5c6b26d0c406', None, None, None, None, None)] {{(pid=124820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:40:10.449788 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Flavor limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:40:10.450212 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Image limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:40:10.450712 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Flavor pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:40:10.451118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Image pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:40:10.451528 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:40:10.460834 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:10.461280 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:10.462075 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:10.462513 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:10.479595 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Getting quotas for project 4088561009754a839604e3798787d8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:40:10.483569 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Getting quotas for user 1b9d76409f834b478981c0bbc0c3d4b6 and project 4088561009754a839604e3798787d8b9. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:40:10.494536 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Going to run 1 instances... {{(pid=124820) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:40:10.496903 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:40:10.666906 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-57345f4f-56e5-43da-a547-08727b1c8155 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.701772 Jul 26 16:40:10.667721 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 380/779] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:40:09 2022] POST /compute/v2.1/servers => generated 403 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 26 16:40:10.678795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e873cbcf-f672-497a-9e40-957781e71651 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:10.679405 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e873cbcf-f672-497a-9e40-957781e71651 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:10.776146 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f66eb6bd-d9bc-461b-9418-4f2d0b1d4d27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:10.776803 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f66eb6bd-d9bc-461b-9418-4f2d0b1d4d27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:10.784430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f66eb6bd-d9bc-461b-9418-4f2d0b1d4d27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:10.785080 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f66eb6bd-d9bc-461b-9418-4f2d0b1d4d27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:10.785875 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f66eb6bd-d9bc-461b-9418-4f2d0b1d4d27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:10.786316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f66eb6bd-d9bc-461b-9418-4f2d0b1d4d27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:10.857320 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f66eb6bd-d9bc-461b-9418-4f2d0b1d4d27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:10.866721 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f66eb6bd-d9bc-461b-9418-4f2d0b1d4d27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:10.868275 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f66eb6bd-d9bc-461b-9418-4f2d0b1d4d27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:10.869518 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f66eb6bd-d9bc-461b-9418-4f2d0b1d4d27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1289 microversion: 2.20 time: 0.097280 Jul 26 16:40:10.870101 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 381/780] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:10 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:10.975476 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e873cbcf-f672-497a-9e40-957781e71651 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:10.983589 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e873cbcf-f672-497a-9e40-957781e71651 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1241 microversion: 2.1 time: 0.308570 Jul 26 16:40:10.984334 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 400/781] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:10 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1241 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:11.893378 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f6b2253d-a497-43c1-a68b-1ca6c764d15b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:11.893987 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f6b2253d-a497-43c1-a68b-1ca6c764d15b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:11.901084 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f6b2253d-a497-43c1-a68b-1ca6c764d15b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:11.901536 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f6b2253d-a497-43c1-a68b-1ca6c764d15b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:11.902684 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f6b2253d-a497-43c1-a68b-1ca6c764d15b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:11.903382 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f6b2253d-a497-43c1-a68b-1ca6c764d15b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:11.964717 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f6b2253d-a497-43c1-a68b-1ca6c764d15b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:11.973335 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f6b2253d-a497-43c1-a68b-1ca6c764d15b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:11.974990 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f6b2253d-a497-43c1-a68b-1ca6c764d15b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:11.976182 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f6b2253d-a497-43c1-a68b-1ca6c764d15b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1289 microversion: 2.20 time: 0.087215 Jul 26 16:40:11.976794 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 382/782] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:11 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1289 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:12.005238 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a3268a13-10c8-47d1-9319-afbbeadff477 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:12.005897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a3268a13-10c8-47d1-9319-afbbeadff477 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:12.013375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a3268a13-10c8-47d1-9319-afbbeadff477 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:12.013844 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a3268a13-10c8-47d1-9319-afbbeadff477 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:12.014597 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a3268a13-10c8-47d1-9319-afbbeadff477 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:12.015059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a3268a13-10c8-47d1-9319-afbbeadff477 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:12.019717 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=91 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:40:12.074734 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a3268a13-10c8-47d1-9319-afbbeadff477 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:12.082764 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a3268a13-10c8-47d1-9319-afbbeadff477 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1245 microversion: 2.1 time: 0.082028 Jul 26 16:40:12.083315 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 401/783] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:11 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:12.998379 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5a77a8ce-4a42-4c32-a829-8edb6bdcddfd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:12.998947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5a77a8ce-4a42-4c32-a829-8edb6bdcddfd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:13.005633 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5a77a8ce-4a42-4c32-a829-8edb6bdcddfd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:13.006083 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5a77a8ce-4a42-4c32-a829-8edb6bdcddfd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:13.006847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5a77a8ce-4a42-4c32-a829-8edb6bdcddfd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:13.007283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5a77a8ce-4a42-4c32-a829-8edb6bdcddfd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:13.021738 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:40:13.070945 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5a77a8ce-4a42-4c32-a829-8edb6bdcddfd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:13.079302 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5a77a8ce-4a42-4c32-a829-8edb6bdcddfd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:13.080862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5a77a8ce-4a42-4c32-a829-8edb6bdcddfd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:13.081950 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5a77a8ce-4a42-4c32-a829-8edb6bdcddfd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1337 microversion: 2.20 time: 0.087502 Jul 26 16:40:13.082501 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 383/784] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:12 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1337 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:13.106833 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6ddb21ff-ec50-469d-ae91-864da1b9725e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:13.107432 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6ddb21ff-ec50-469d-ae91-864da1b9725e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:13.113883 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ddb21ff-ec50-469d-ae91-864da1b9725e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:13.114328 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ddb21ff-ec50-469d-ae91-864da1b9725e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:13.115075 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ddb21ff-ec50-469d-ae91-864da1b9725e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:13.115503 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ddb21ff-ec50-469d-ae91-864da1b9725e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:13.175185 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6ddb21ff-ec50-469d-ae91-864da1b9725e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:13.182393 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6ddb21ff-ec50-469d-ae91-864da1b9725e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1293 microversion: 2.1 time: 0.079326 Jul 26 16:40:13.182947 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 402/785] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:13 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1293 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:14.105411 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f0a42ddb-eca1-47d4-8dfa-2dbcf7749583 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:14.106746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f0a42ddb-eca1-47d4-8dfa-2dbcf7749583 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:14.113759 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f0a42ddb-eca1-47d4-8dfa-2dbcf7749583 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:14.114338 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f0a42ddb-eca1-47d4-8dfa-2dbcf7749583 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:14.115121 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f0a42ddb-eca1-47d4-8dfa-2dbcf7749583 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:14.115567 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f0a42ddb-eca1-47d4-8dfa-2dbcf7749583 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:14.185793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f0a42ddb-eca1-47d4-8dfa-2dbcf7749583 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:14.200042 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f0a42ddb-eca1-47d4-8dfa-2dbcf7749583 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:14.201943 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f0a42ddb-eca1-47d4-8dfa-2dbcf7749583 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:14.204764 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f0a42ddb-eca1-47d4-8dfa-2dbcf7749583 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1343 microversion: 2.20 time: 0.102885 Jul 26 16:40:14.204991 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-acd67b52-b5b3-4965-8cf0-41b2c0279767 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:14.205515 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 384/786] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:14 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1343 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:14.221017 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-acd67b52-b5b3-4965-8cf0-41b2c0279767 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:14.238248 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-acd67b52-b5b3-4965-8cf0-41b2c0279767 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:14.238707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-acd67b52-b5b3-4965-8cf0-41b2c0279767 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:14.239496 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-acd67b52-b5b3-4965-8cf0-41b2c0279767 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:14.239938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-acd67b52-b5b3-4965-8cf0-41b2c0279767 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:14.317783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-acd67b52-b5b3-4965-8cf0-41b2c0279767 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:14.325736 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-acd67b52-b5b3-4965-8cf0-41b2c0279767 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1311 microversion: 2.1 time: 0.125800 Jul 26 16:40:14.326302 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 403/787] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:14 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1311 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:40:15.234647 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d9e446e4-b181-4fb3-b9f0-6da18c323446 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:15.235287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d9e446e4-b181-4fb3-b9f0-6da18c323446 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:15.248490 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d9e446e4-b181-4fb3-b9f0-6da18c323446 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:15.252933 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d9e446e4-b181-4fb3-b9f0-6da18c323446 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:15.253837 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d9e446e4-b181-4fb3-b9f0-6da18c323446 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:15.254224 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d9e446e4-b181-4fb3-b9f0-6da18c323446 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:15.347283 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2bb9a7dc-365f-4c6a-b2cc-8113e62d2b7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:15.348540 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2bb9a7dc-365f-4c6a-b2cc-8113e62d2b7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:15.356314 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2bb9a7dc-365f-4c6a-b2cc-8113e62d2b7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:15.357471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2bb9a7dc-365f-4c6a-b2cc-8113e62d2b7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:15.358704 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2bb9a7dc-365f-4c6a-b2cc-8113e62d2b7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:15.359288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2bb9a7dc-365f-4c6a-b2cc-8113e62d2b7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:15.521661 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d9e446e4-b181-4fb3-b9f0-6da18c323446 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:15.550073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d9e446e4-b181-4fb3-b9f0-6da18c323446 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:15.554589 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d9e446e4-b181-4fb3-b9f0-6da18c323446 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:15.559118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d9e446e4-b181-4fb3-b9f0-6da18c323446 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1411 microversion: 2.20 time: 0.328710 Jul 26 16:40:15.560330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 385/788] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:15 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1411 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:40:15.572306 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2bb9a7dc-365f-4c6a-b2cc-8113e62d2b7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:15.580580 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2bb9a7dc-365f-4c6a-b2cc-8113e62d2b7a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.237194 Jul 26 16:40:15.581154 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 404/789] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:15 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:40:15.687385 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-b90ab108-0d52-45ca-a6f3-4c67e9e53a49 req-121590b4-27fb-4fff-a790-8c1a5e673587 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959309a9-7e80-4fa3-a819-5c64c66861e5", "tag": "5e531cc9-c347-49e5-b738-d36aac7e7939"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:15.711424 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-b90ab108-0d52-45ca-a6f3-4c67e9e53a49 req-121590b4-27fb-4fff-a790-8c1a5e673587 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:15.711944 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-b90ab108-0d52-45ca-a6f3-4c67e9e53a49 req-121590b4-27fb-4fff-a790-8c1a5e673587 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:15.724061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-b90ab108-0d52-45ca-a6f3-4c67e9e53a49 req-121590b4-27fb-4fff-a790-8c1a5e673587 service nova] Creating event network-changed:5e531cc9-c347-49e5-b738-d36aac7e7939 for instance 959309a9-7e80-4fa3-a819-5c64c66861e5 on hv-cinder-85104 Jul 26 16:40:15.729604 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-b90ab108-0d52-45ca-a6f3-4c67e9e53a49 req-121590b4-27fb-4fff-a790-8c1a5e673587 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052304 Jul 26 16:40:15.730218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 386/790] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:40:16.159893 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-ebbf3a41-0708-49a9-8315-645d12e45879 req-c0695d73-bcc0-4c7c-9e19-9fdb5233d39e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b55f3f-7f6d-4179-8574-11cc47c32566", "tag": "1c0fda89-08d0-4795-a5e6-64bfd611749d"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:16.172176 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-ebbf3a41-0708-49a9-8315-645d12e45879 req-c0695d73-bcc0-4c7c-9e19-9fdb5233d39e service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:16.173190 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-ebbf3a41-0708-49a9-8315-645d12e45879 req-c0695d73-bcc0-4c7c-9e19-9fdb5233d39e service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:16.193384 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-ebbf3a41-0708-49a9-8315-645d12e45879 req-c0695d73-bcc0-4c7c-9e19-9fdb5233d39e service nova] Creating event network-changed:1c0fda89-08d0-4795-a5e6-64bfd611749d for instance b9b55f3f-7f6d-4179-8574-11cc47c32566 on hv-cinder-85104 Jul 26 16:40:16.198313 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-ebbf3a41-0708-49a9-8315-645d12e45879 req-c0695d73-bcc0-4c7c-9e19-9fdb5233d39e service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042248 Jul 26 16:40:16.199224 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 405/791] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:40:16.598427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4df01b97-f915-42d2-b8dd-9bae3788f6a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:16.599271 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4df01b97-f915-42d2-b8dd-9bae3788f6a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:16.604590 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a689a092-7c56-47d3-91fa-7b0a4cea4efc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:16.605294 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a689a092-7c56-47d3-91fa-7b0a4cea4efc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:16.606159 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4df01b97-f915-42d2-b8dd-9bae3788f6a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:16.606685 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4df01b97-f915-42d2-b8dd-9bae3788f6a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:16.607664 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4df01b97-f915-42d2-b8dd-9bae3788f6a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:16.608271 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4df01b97-f915-42d2-b8dd-9bae3788f6a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:16.615649 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a689a092-7c56-47d3-91fa-7b0a4cea4efc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:16.618806 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a689a092-7c56-47d3-91fa-7b0a4cea4efc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:16.622447 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a689a092-7c56-47d3-91fa-7b0a4cea4efc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:16.622447 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a689a092-7c56-47d3-91fa-7b0a4cea4efc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:16.768998 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4df01b97-f915-42d2-b8dd-9bae3788f6a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:16.776963 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4df01b97-f915-42d2-b8dd-9bae3788f6a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:16.778748 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4df01b97-f915-42d2-b8dd-9bae3788f6a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:16.779851 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4df01b97-f915-42d2-b8dd-9bae3788f6a8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1411 microversion: 2.20 time: 0.197197 Jul 26 16:40:16.780437 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 387/792] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:16 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1411 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:16.800954 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a689a092-7c56-47d3-91fa-7b0a4cea4efc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:16.808244 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a689a092-7c56-47d3-91fa-7b0a4cea4efc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.208428 Jul 26 16:40:16.808850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 406/793] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:16 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:17.802022 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5f72c7f3-3243-4b5e-8dfe-1029364bbdbd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:17.802641 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5f72c7f3-3243-4b5e-8dfe-1029364bbdbd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:17.809486 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5f72c7f3-3243-4b5e-8dfe-1029364bbdbd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:17.809937 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5f72c7f3-3243-4b5e-8dfe-1029364bbdbd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:17.810706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5f72c7f3-3243-4b5e-8dfe-1029364bbdbd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:17.811141 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5f72c7f3-3243-4b5e-8dfe-1029364bbdbd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:17.830099 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1d99056b-2b4d-4cc9-b1d5-f925cdf0d1e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:17.830713 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1d99056b-2b4d-4cc9-b1d5-f925cdf0d1e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:17.843364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d99056b-2b4d-4cc9-b1d5-f925cdf0d1e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:17.843364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d99056b-2b4d-4cc9-b1d5-f925cdf0d1e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:17.843364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d99056b-2b4d-4cc9-b1d5-f925cdf0d1e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:17.843364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d99056b-2b4d-4cc9-b1d5-f925cdf0d1e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:17.947037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5f72c7f3-3243-4b5e-8dfe-1029364bbdbd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:17.955788 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5f72c7f3-3243-4b5e-8dfe-1029364bbdbd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:17.957323 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5f72c7f3-3243-4b5e-8dfe-1029364bbdbd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:17.958427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5f72c7f3-3243-4b5e-8dfe-1029364bbdbd tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1411 microversion: 2.20 time: 0.160377 Jul 26 16:40:17.959062 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 388/794] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:17 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1411 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:17.993252 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1d99056b-2b4d-4cc9-b1d5-f925cdf0d1e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:18.001212 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1d99056b-2b4d-4cc9-b1d5-f925cdf0d1e8 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.175011 Jul 26 16:40:18.001775 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 407/795] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:17 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:40:18.981746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e2af982a-bc93-4d5c-8c9f-a06a2cd3a597 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:18.982377 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e2af982a-bc93-4d5c-8c9f-a06a2cd3a597 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:18.990452 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e2af982a-bc93-4d5c-8c9f-a06a2cd3a597 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:18.990903 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e2af982a-bc93-4d5c-8c9f-a06a2cd3a597 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:18.991702 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e2af982a-bc93-4d5c-8c9f-a06a2cd3a597 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:18.992190 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e2af982a-bc93-4d5c-8c9f-a06a2cd3a597 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:19.023280 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0a51928c-1134-4ec0-be6d-2d5b48663d2b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:19.024040 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0a51928c-1134-4ec0-be6d-2d5b48663d2b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:19.026258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:40:19.032415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0a51928c-1134-4ec0-be6d-2d5b48663d2b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:19.032866 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0a51928c-1134-4ec0-be6d-2d5b48663d2b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:19.033632 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0a51928c-1134-4ec0-be6d-2d5b48663d2b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:19.034129 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0a51928c-1134-4ec0-be6d-2d5b48663d2b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:19.147266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e2af982a-bc93-4d5c-8c9f-a06a2cd3a597 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:19.147266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e2af982a-bc93-4d5c-8c9f-a06a2cd3a597 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:19.148132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e2af982a-bc93-4d5c-8c9f-a06a2cd3a597 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:19.148132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e2af982a-bc93-4d5c-8c9f-a06a2cd3a597 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1411 microversion: 2.20 time: 0.163819 Jul 26 16:40:19.148132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 389/796] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:18 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:19.162666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0a51928c-1134-4ec0-be6d-2d5b48663d2b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:19.171680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0a51928c-1134-4ec0-be6d-2d5b48663d2b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.152498 Jul 26 16:40:19.172251 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 408/797] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:19 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:20.165675 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b6d2c2ad-177d-4aca-b56a-df9e59155732 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:20.166214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b6d2c2ad-177d-4aca-b56a-df9e59155732 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:20.173025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b6d2c2ad-177d-4aca-b56a-df9e59155732 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:20.173490 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b6d2c2ad-177d-4aca-b56a-df9e59155732 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:20.174220 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b6d2c2ad-177d-4aca-b56a-df9e59155732 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:20.174862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b6d2c2ad-177d-4aca-b56a-df9e59155732 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:20.195902 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9922d44e-542e-494e-93c0-0fa79e6eca9f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:20.197619 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9922d44e-542e-494e-93c0-0fa79e6eca9f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:20.206690 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9922d44e-542e-494e-93c0-0fa79e6eca9f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:20.207887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9922d44e-542e-494e-93c0-0fa79e6eca9f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:20.208023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9922d44e-542e-494e-93c0-0fa79e6eca9f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:20.208400 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9922d44e-542e-494e-93c0-0fa79e6eca9f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:20.321636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b6d2c2ad-177d-4aca-b56a-df9e59155732 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:20.334122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b6d2c2ad-177d-4aca-b56a-df9e59155732 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:20.335940 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b6d2c2ad-177d-4aca-b56a-df9e59155732 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:20.337083 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b6d2c2ad-177d-4aca-b56a-df9e59155732 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1411 microversion: 2.20 time: 0.176696 Jul 26 16:40:20.351486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9922d44e-542e-494e-93c0-0fa79e6eca9f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:20.353624 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 390/798] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:20 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1411 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:20.360109 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9922d44e-542e-494e-93c0-0fa79e6eca9f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.170563 Jul 26 16:40:20.360835 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 409/799] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:20 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:21.362284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-69bb085c-1a32-48d2-933b-c53cb0fcc374 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:21.362284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-69bb085c-1a32-48d2-933b-c53cb0fcc374 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:21.366016 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:40:21.366681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=16 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:40:21.368195 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69bb085c-1a32-48d2-933b-c53cb0fcc374 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:21.368665 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69bb085c-1a32-48d2-933b-c53cb0fcc374 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:21.369437 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69bb085c-1a32-48d2-933b-c53cb0fcc374 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:21.369882 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69bb085c-1a32-48d2-933b-c53cb0fcc374 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:21.381257 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c982aa2f-b636-4dca-964f-febe2424211c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:21.386431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c982aa2f-b636-4dca-964f-febe2424211c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:21.386431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=8 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:40:21.389516 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c982aa2f-b636-4dca-964f-febe2424211c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:21.389969 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c982aa2f-b636-4dca-964f-febe2424211c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:21.390741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c982aa2f-b636-4dca-964f-febe2424211c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:21.391177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c982aa2f-b636-4dca-964f-febe2424211c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:21.513181 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-69bb085c-1a32-48d2-933b-c53cb0fcc374 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:21.521603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-69bb085c-1a32-48d2-933b-c53cb0fcc374 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:21.523287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-69bb085c-1a32-48d2-933b-c53cb0fcc374 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:21.524566 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-69bb085c-1a32-48d2-933b-c53cb0fcc374 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1411 microversion: 2.20 time: 0.168964 Jul 26 16:40:21.525700 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 391/800] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:21 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1411 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:21.539275 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c982aa2f-b636-4dca-964f-febe2424211c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:21.547181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c982aa2f-b636-4dca-964f-febe2424211c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.169917 Jul 26 16:40:21.548289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 410/801] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:21 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:40:22.547086 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-95061e02-c51a-44c6-9a68-1165f00efd2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:22.548323 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-95061e02-c51a-44c6-9a68-1165f00efd2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:22.551773 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=5 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:40:22.569233 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-95061e02-c51a-44c6-9a68-1165f00efd2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:22.569490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-837ef0f8-2dd9-47cc-979a-c9d7e1a230dc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:22.569961 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-95061e02-c51a-44c6-9a68-1165f00efd2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:22.570455 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-95061e02-c51a-44c6-9a68-1165f00efd2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:22.570910 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-837ef0f8-2dd9-47cc-979a-c9d7e1a230dc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:22.571003 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-95061e02-c51a-44c6-9a68-1165f00efd2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:22.578362 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-837ef0f8-2dd9-47cc-979a-c9d7e1a230dc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:22.578871 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-837ef0f8-2dd9-47cc-979a-c9d7e1a230dc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:22.579637 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-837ef0f8-2dd9-47cc-979a-c9d7e1a230dc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:22.580148 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-837ef0f8-2dd9-47cc-979a-c9d7e1a230dc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:22.706116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-95061e02-c51a-44c6-9a68-1165f00efd2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:22.715002 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-95061e02-c51a-44c6-9a68-1165f00efd2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:22.716741 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-95061e02-c51a-44c6-9a68-1165f00efd2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:22.718049 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-95061e02-c51a-44c6-9a68-1165f00efd2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1411 microversion: 2.20 time: 0.174906 Jul 26 16:40:22.726822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-837ef0f8-2dd9-47cc-979a-c9d7e1a230dc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:22.732628 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 392/802] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:22 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1411 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:22.734414 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-837ef0f8-2dd9-47cc-979a-c9d7e1a230dc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.169853 Jul 26 16:40:22.740163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-6969e0aa-0771-4512-b714-dff5619ad1ef req-4821b08c-af83-47f4-a948-7c865f0e62a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959309a9-7e80-4fa3-a819-5c64c66861e5", "name": "network-vif-plugged", "status": "completed", "tag": "5e531cc9-c347-49e5-b738-d36aac7e7939"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:22.740772 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 411/803] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:22 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:40:22.750202 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-6969e0aa-0771-4512-b714-dff5619ad1ef req-4821b08c-af83-47f4-a948-7c865f0e62a6 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:22.752010 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-6969e0aa-0771-4512-b714-dff5619ad1ef req-4821b08c-af83-47f4-a948-7c865f0e62a6 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:22.761826 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-6969e0aa-0771-4512-b714-dff5619ad1ef req-4821b08c-af83-47f4-a948-7c865f0e62a6 service nova] Creating event network-vif-plugged:5e531cc9-c347-49e5-b738-d36aac7e7939 for instance 959309a9-7e80-4fa3-a819-5c64c66861e5 on hv-cinder-85104 Jul 26 16:40:22.766827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-6969e0aa-0771-4512-b714-dff5619ad1ef req-4821b08c-af83-47f4-a948-7c865f0e62a6 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Jul 26 16:40:22.767391 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 393/804] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:40:23.743865 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5ef50ca0-b018-46ae-b4e0-e988c7b73fe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:23.744550 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5ef50ca0-b018-46ae-b4e0-e988c7b73fe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:23.752612 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5ef50ca0-b018-46ae-b4e0-e988c7b73fe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:23.753060 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5ef50ca0-b018-46ae-b4e0-e988c7b73fe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:23.753825 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5ef50ca0-b018-46ae-b4e0-e988c7b73fe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:23.754255 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5ef50ca0-b018-46ae-b4e0-e988c7b73fe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:23.757271 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d6c5ab09-0954-4f9d-81cc-d90a9aff52e9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:23.758043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d6c5ab09-0954-4f9d-81cc-d90a9aff52e9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:23.764970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d6c5ab09-0954-4f9d-81cc-d90a9aff52e9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:23.765498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d6c5ab09-0954-4f9d-81cc-d90a9aff52e9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:23.766338 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d6c5ab09-0954-4f9d-81cc-d90a9aff52e9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:23.766781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d6c5ab09-0954-4f9d-81cc-d90a9aff52e9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:23.886169 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5ef50ca0-b018-46ae-b4e0-e988c7b73fe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:23.894442 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5ef50ca0-b018-46ae-b4e0-e988c7b73fe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:23.895936 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5ef50ca0-b018-46ae-b4e0-e988c7b73fe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:23.897248 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5ef50ca0-b018-46ae-b4e0-e988c7b73fe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1411 microversion: 2.20 time: 0.157398 Jul 26 16:40:23.897805 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 412/805] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:23 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1411 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:40:23.904659 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d6c5ab09-0954-4f9d-81cc-d90a9aff52e9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:23.912144 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d6c5ab09-0954-4f9d-81cc-d90a9aff52e9 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.159825 Jul 26 16:40:23.913248 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 394/806] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:23 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:24.919949 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3ba1a73c-eb85-423b-b6f2-1ab3ec2a5d2d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:24.920736 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3ba1a73c-eb85-423b-b6f2-1ab3ec2a5d2d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:24.927349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3ba1a73c-eb85-423b-b6f2-1ab3ec2a5d2d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:24.932474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3ba1a73c-eb85-423b-b6f2-1ab3ec2a5d2d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:24.932474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3ba1a73c-eb85-423b-b6f2-1ab3ec2a5d2d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:24.932474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3ba1a73c-eb85-423b-b6f2-1ab3ec2a5d2d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:24.935032 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bb009a53-9d1a-449e-8220-b61036605298 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:24.935845 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bb009a53-9d1a-449e-8220-b61036605298 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:24.943074 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bb009a53-9d1a-449e-8220-b61036605298 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:24.943526 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bb009a53-9d1a-449e-8220-b61036605298 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:24.944282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bb009a53-9d1a-449e-8220-b61036605298 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:24.944741 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bb009a53-9d1a-449e-8220-b61036605298 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:25.071993 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3ba1a73c-eb85-423b-b6f2-1ab3ec2a5d2d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:25.078570 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bb009a53-9d1a-449e-8220-b61036605298 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:25.081217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3ba1a73c-eb85-423b-b6f2-1ab3ec2a5d2d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:25.082905 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3ba1a73c-eb85-423b-b6f2-1ab3ec2a5d2d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:25.084108 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3ba1a73c-eb85-423b-b6f2-1ab3ec2a5d2d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1411 microversion: 2.20 time: 0.168094 Jul 26 16:40:25.084762 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 413/807] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:24 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1411 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:25.086622 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bb009a53-9d1a-449e-8220-b61036605298 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.156440 Jul 26 16:40:25.087176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 395/808] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:24 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:40:26.106062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-07d424da-14c2-4b67-8656-67404cc87002 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:26.106614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-07d424da-14c2-4b67-8656-67404cc87002 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:26.107363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-75aa6803-72b4-4968-a010-be09029aab5a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:26.108099 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-75aa6803-72b4-4968-a010-be09029aab5a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:26.113531 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-07d424da-14c2-4b67-8656-67404cc87002 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:26.113973 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-07d424da-14c2-4b67-8656-67404cc87002 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:26.114729 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-07d424da-14c2-4b67-8656-67404cc87002 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:26.114970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-75aa6803-72b4-4968-a010-be09029aab5a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:26.115157 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-07d424da-14c2-4b67-8656-67404cc87002 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:26.115424 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-75aa6803-72b4-4968-a010-be09029aab5a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:26.116222 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-75aa6803-72b4-4968-a010-be09029aab5a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:26.116687 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-75aa6803-72b4-4968-a010-be09029aab5a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:26.244457 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-75aa6803-72b4-4968-a010-be09029aab5a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:26.244945 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-07d424da-14c2-4b67-8656-67404cc87002 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:26.252011 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-75aa6803-72b4-4968-a010-be09029aab5a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.148565 Jul 26 16:40:26.252610 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 396/809] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:26 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:40:26.252789 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-07d424da-14c2-4b67-8656-67404cc87002 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:26.254287 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-07d424da-14c2-4b67-8656-67404cc87002 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:26.255428 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-07d424da-14c2-4b67-8656-67404cc87002 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1603 microversion: 2.20 time: 0.153429 Jul 26 16:40:26.255962 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 414/810] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:40:26 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1603 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:40:26.276671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-69cf04c9-bc44-4a83-9eaa-089f22daa67d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:26.277158 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-69cf04c9-bc44-4a83-9eaa-089f22daa67d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:26.283791 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69cf04c9-bc44-4a83-9eaa-089f22daa67d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:26.284416 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69cf04c9-bc44-4a83-9eaa-089f22daa67d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:26.285191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69cf04c9-bc44-4a83-9eaa-089f22daa67d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:26.285622 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69cf04c9-bc44-4a83-9eaa-089f22daa67d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:26.371454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-69cf04c9-bc44-4a83-9eaa-089f22daa67d tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098530 Jul 26 16:40:26.372335 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 397/811] 10.222.0.144 () {60 vars in 1321 bytes} [Tue Jul 26 16:40:26 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:40:26.606261 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-7a6f368e-5ae7-49a2-abca-351a1fcf5611 req-6eb9d17b-c304-4e22-8a07-2d36ffb1e28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b55f3f-7f6d-4179-8574-11cc47c32566", "name": "network-vif-plugged", "status": "completed", "tag": "1c0fda89-08d0-4795-a5e6-64bfd611749d"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:26.620881 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-7a6f368e-5ae7-49a2-abca-351a1fcf5611 req-6eb9d17b-c304-4e22-8a07-2d36ffb1e28f service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:26.621387 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-7a6f368e-5ae7-49a2-abca-351a1fcf5611 req-6eb9d17b-c304-4e22-8a07-2d36ffb1e28f service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:26.634305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-7a6f368e-5ae7-49a2-abca-351a1fcf5611 req-6eb9d17b-c304-4e22-8a07-2d36ffb1e28f service nova] Creating event network-vif-plugged:1c0fda89-08d0-4795-a5e6-64bfd611749d for instance b9b55f3f-7f6d-4179-8574-11cc47c32566 on hv-cinder-85104 Jul 26 16:40:26.640219 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-7a6f368e-5ae7-49a2-abca-351a1fcf5611 req-6eb9d17b-c304-4e22-8a07-2d36ffb1e28f service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037892 Jul 26 16:40:26.641143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 415/812] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:40:27.274357 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-62770e02-010d-490a-bb95-8952755615f0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:27.274899 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-62770e02-010d-490a-bb95-8952755615f0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:27.281213 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-62770e02-010d-490a-bb95-8952755615f0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:27.281834 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-62770e02-010d-490a-bb95-8952755615f0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:27.282487 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-62770e02-010d-490a-bb95-8952755615f0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:27.282920 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-62770e02-010d-490a-bb95-8952755615f0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:27.494881 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-62770e02-010d-490a-bb95-8952755615f0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:27.503005 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-62770e02-010d-490a-bb95-8952755615f0 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.233205 Jul 26 16:40:27.503578 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 398/813] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:27 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:27.807087 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-e077895b-941d-4caf-ba84-8b439e8db709 req-226ec802-3ddf-438e-9622-0e8f435fc048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959309a9-7e80-4fa3-a819-5c64c66861e5", "tag": "5e531cc9-c347-49e5-b738-d36aac7e7939"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:27.812141 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:40:27.817445 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-e077895b-941d-4caf-ba84-8b439e8db709 req-226ec802-3ddf-438e-9622-0e8f435fc048 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:27.818071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-e077895b-941d-4caf-ba84-8b439e8db709 req-226ec802-3ddf-438e-9622-0e8f435fc048 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:27.831478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-e077895b-941d-4caf-ba84-8b439e8db709 req-226ec802-3ddf-438e-9622-0e8f435fc048 service nova] Creating event network-changed:5e531cc9-c347-49e5-b738-d36aac7e7939 for instance 959309a9-7e80-4fa3-a819-5c64c66861e5 on hv-cinder-85104 Jul 26 16:40:27.834630 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-e077895b-941d-4caf-ba84-8b439e8db709 req-226ec802-3ddf-438e-9622-0e8f435fc048 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032070 Jul 26 16:40:27.835502 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 416/814] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:40:28.526317 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-186824ac-47a1-473a-8770-5805188ce8cf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:28.528739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-186824ac-47a1-473a-8770-5805188ce8cf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:28.538583 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-186824ac-47a1-473a-8770-5805188ce8cf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:28.539267 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-186824ac-47a1-473a-8770-5805188ce8cf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:28.540518 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-186824ac-47a1-473a-8770-5805188ce8cf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:28.541098 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-186824ac-47a1-473a-8770-5805188ce8cf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:28.690679 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-186824ac-47a1-473a-8770-5805188ce8cf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:28.700176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-186824ac-47a1-473a-8770-5805188ce8cf tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1366 microversion: 2.1 time: 0.179818 Jul 26 16:40:28.700953 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 399/815] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:28 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:29.722160 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a25816e1-2830-4ac3-b3f7-a040a18aa46c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:29.722858 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a25816e1-2830-4ac3-b3f7-a040a18aa46c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:29.729280 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a25816e1-2830-4ac3-b3f7-a040a18aa46c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:29.729730 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a25816e1-2830-4ac3-b3f7-a040a18aa46c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:29.730496 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a25816e1-2830-4ac3-b3f7-a040a18aa46c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:29.730932 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a25816e1-2830-4ac3-b3f7-a040a18aa46c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:29.870332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a25816e1-2830-4ac3-b3f7-a040a18aa46c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:40:29.878108 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a25816e1-2830-4ac3-b3f7-a040a18aa46c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1551 microversion: 2.1 time: 0.161045 Jul 26 16:40:29.882173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 417/816] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:40:29 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:40:29.899341 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-89dc052f-41ea-481d-a107-cfaa15e69e35 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:29.899852 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-89dc052f-41ea-481d-a107-cfaa15e69e35 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:29.907474 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-89dc052f-41ea-481d-a107-cfaa15e69e35 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:29.907940 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-89dc052f-41ea-481d-a107-cfaa15e69e35 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:29.908749 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-89dc052f-41ea-481d-a107-cfaa15e69e35 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:29.909186 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-89dc052f-41ea-481d-a107-cfaa15e69e35 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:29.985475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-89dc052f-41ea-481d-a107-cfaa15e69e35 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089644 Jul 26 16:40:29.985802 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 400/817] 10.222.0.144 () {58 vars in 1280 bytes} [Tue Jul 26 16:40:29 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:40:31.044354 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-7c06d0f3-6d5d-4e4d-80e5-6c71b73a3e1f req-27addd73-34cd-43d2-a901-8eb6e78b66f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b55f3f-7f6d-4179-8574-11cc47c32566", "tag": "1c0fda89-08d0-4795-a5e6-64bfd611749d"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:40:31.055394 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-7c06d0f3-6d5d-4e4d-80e5-6c71b73a3e1f req-27addd73-34cd-43d2-a901-8eb6e78b66f6 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:31.055837 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-7c06d0f3-6d5d-4e4d-80e5-6c71b73a3e1f req-27addd73-34cd-43d2-a901-8eb6e78b66f6 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:31.068799 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-7c06d0f3-6d5d-4e4d-80e5-6c71b73a3e1f req-27addd73-34cd-43d2-a901-8eb6e78b66f6 service nova] Creating event network-changed:1c0fda89-08d0-4795-a5e6-64bfd611749d for instance b9b55f3f-7f6d-4179-8574-11cc47c32566 on hv-cinder-85104 Jul 26 16:40:31.073708 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-7c06d0f3-6d5d-4e4d-80e5-6c71b73a3e1f req-27addd73-34cd-43d2-a901-8eb6e78b66f6 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032975 Jul 26 16:40:31.074707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 418/818] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:40:57.772436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=17 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:40:57.773220 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=93 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:40:57.777073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0326fe4e-2073-41eb-8314-8dddadb876e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:40:57.777563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0326fe4e-2073-41eb-8314-8dddadb876e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:40:57.783607 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0326fe4e-2073-41eb-8314-8dddadb876e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:57.784073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0326fe4e-2073-41eb-8314-8dddadb876e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:57.784872 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0326fe4e-2073-41eb-8314-8dddadb876e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:40:57.785308 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0326fe4e-2073-41eb-8314-8dddadb876e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:40:57.807180 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0326fe4e-2073-41eb-8314-8dddadb876e1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/ips" status: 200 len: 150 microversion: 2.1 time: 0.036489 Jul 26 16:40:57.807727 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 401/819] 10.222.0.144 () {58 vars in 1253 bytes} [Tue Jul 26 16:40:57 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:41:00.846430 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=5 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:00.847164 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=91 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:00.851528 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ab055f5b-78b5-4498-b35a-4c7c869558df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "321ab422-2def-490c-8418-a337c242f993"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:00.853974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ab055f5b-78b5-4498-b35a-4c7c869558df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:00.859987 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab055f5b-78b5-4498-b35a-4c7c869558df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:00.860470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab055f5b-78b5-4498-b35a-4c7c869558df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:00.861277 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab055f5b-78b5-4498-b35a-4c7c869558df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:00.861709 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab055f5b-78b5-4498-b35a-4c7c869558df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:02.355302 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ab055f5b-78b5-4498-b35a-4c7c869558df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.510268 Jul 26 16:41:02.355952 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 419/820] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:41:00 2022] POST /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments => generated 194 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:41:14.475872 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-33e3150c-52c4-4e38-8d78-eb8249cca0f3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "321ab422-2def-490c-8418-a337c242f993"}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:14.478143 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-33e3150c-52c4-4e38-8d78-eb8249cca0f3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:14.485421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-33e3150c-52c4-4e38-8d78-eb8249cca0f3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:14.485874 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-33e3150c-52c4-4e38-8d78-eb8249cca0f3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:14.487242 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-33e3150c-52c4-4e38-8d78-eb8249cca0f3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:14.487679 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-33e3150c-52c4-4e38-8d78-eb8249cca0f3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:14.566812 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-33e3150c-52c4-4e38-8d78-eb8249cca0f3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Invalid volume: volume 321ab422-2def-490c-8418-a337c242f993 is already attached to instances: 5c11953c-a484-4d00-a221-e03e55f46dc4 Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-33e3150c-52c4-4e38-8d78-eb8249cca0f3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: POST /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments HTTP/1.1 Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 74 Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:41:14.568787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {"volumeAttachment": {"volumeId": "321ab422-2def-490c-8418-a337c242f993"}} Jul 26 16:41:14.570354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Invalid volume: volume 321ab422-2def-490c-8418-a337c242f993 is already attached to instances: 5c11953c-a484-4d00-a221-e03e55f46dc4 Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'server_id': '5c11953c-a484-4d00-a221-e03e55f46dc4', 'body': {'volumeAttachment': {'volumeId': '321ab422-2def-490c-8418-a337c242f993'}}} Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 321ab422-2def-490c-8418-a337c242f993 is already attached to instances: 5c11953c-a484-4d00-a221-e03e55f46dc4 Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:14.571282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 321ab422-2def-490c-8418-a337c242f993 is already attached to instances: 5c11953c-a484-4d00-a221-e03e55f46dc4 Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:41:14.572760 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:41:14.574313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:41:14.574313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:41:14.574313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:41:14.574313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 321ab422-2def-490c-8418-a337c242f993 is already attached to instances: 5c11953c-a484-4d00-a221-e03e55f46dc4 Jul 26 16:41:14.574313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:14.574313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-33e3150c-52c4-4e38-8d78-eb8249cca0f3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 400 to user: Invalid volume: volume 321ab422-2def-490c-8418-a337c242f993 is already attached to instances: 5c11953c-a484-4d00-a221-e03e55f46dc4 {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:41:14.574313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-33e3150c-52c4-4e38-8d78-eb8249cca0f3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099312 Jul 26 16:41:14.574313 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 402/821] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:41:14 2022] POST /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 26 16:41:14.632308 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:14.633439 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:14.637429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-166d227b-4d4e-4d26-9c4f-5b7052c297b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:14.638020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-166d227b-4d4e-4d26-9c4f-5b7052c297b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:14.649003 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-166d227b-4d4e-4d26-9c4f-5b7052c297b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:14.649446 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-166d227b-4d4e-4d26-9c4f-5b7052c297b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:14.651242 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-166d227b-4d4e-4d26-9c4f-5b7052c297b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:14.651242 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-166d227b-4d4e-4d26-9c4f-5b7052c297b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:14.778245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-166d227b-4d4e-4d26-9c4f-5b7052c297b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lazy-loading 'services' on Instance uuid 5c11953c-a484-4d00-a221-e03e55f46dc4 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:41:15.192635 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-166d227b-4d4e-4d26-9c4f-5b7052c297b3 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments/321ab422-2def-490c-8418-a337c242f993" status: 202 len: 0 microversion: 2.1 time: 0.561514 Jul 26 16:41:15.193220 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 420/822] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:41:14 2022] DELETE /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments/321ab422-2def-490c-8418-a337c242f993 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:41:15.201941 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-93878e3f-afcc-49df-bffb-f5161c851555 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:15.204275 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-93878e3f-afcc-49df-bffb-f5161c851555 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:15.211834 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-93878e3f-afcc-49df-bffb-f5161c851555 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:15.212276 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-93878e3f-afcc-49df-bffb-f5161c851555 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:15.213065 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-93878e3f-afcc-49df-bffb-f5161c851555 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:15.213497 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-93878e3f-afcc-49df-bffb-f5161c851555 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:15.240947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-93878e3f-afcc-49df-bffb-f5161c851555 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043020 Jul 26 16:41:15.241486 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 403/823] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:41:15 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:41:16.254361 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e564bb05-d899-482c-b4b9-acc08e6de803 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:16.256657 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e564bb05-d899-482c-b4b9-acc08e6de803 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:16.264193 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e564bb05-d899-482c-b4b9-acc08e6de803 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:16.264686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e564bb05-d899-482c-b4b9-acc08e6de803 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:16.265443 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e564bb05-d899-482c-b4b9-acc08e6de803 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:16.265874 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e564bb05-d899-482c-b4b9-acc08e6de803 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:16.295186 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e564bb05-d899-482c-b4b9-acc08e6de803 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045603 Jul 26 16:41:16.295736 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 421/824] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:41:16 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:41:17.307458 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ef6bb8f7-e16d-47b0-b979-66a165a9a6fd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:17.309566 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ef6bb8f7-e16d-47b0-b979-66a165a9a6fd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:17.316058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ef6bb8f7-e16d-47b0-b979-66a165a9a6fd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:17.316542 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ef6bb8f7-e16d-47b0-b979-66a165a9a6fd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:17.317304 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ef6bb8f7-e16d-47b0-b979-66a165a9a6fd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:17.317744 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ef6bb8f7-e16d-47b0-b979-66a165a9a6fd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:17.344732 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ef6bb8f7-e16d-47b0-b979-66a165a9a6fd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041272 Jul 26 16:41:17.345273 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 404/825] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:41:17 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 16:41:17.412311 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-163dc916-8f9f-4a36-a2e2-b3f16e7c7ab8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:17.412822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-163dc916-8f9f-4a36-a2e2-b3f16e7c7ab8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:17.420021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-163dc916-8f9f-4a36-a2e2-b3f16e7c7ab8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:17.420596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-163dc916-8f9f-4a36-a2e2-b3f16e7c7ab8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:17.421564 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-163dc916-8f9f-4a36-a2e2-b3f16e7c7ab8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:17.422098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-163dc916-8f9f-4a36-a2e2-b3f16e7c7ab8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:17.451240 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-163dc916-8f9f-4a36-a2e2-b3f16e7c7ab8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Going to try to terminate instance {{(pid=124821) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:41:17.951720 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-163dc916-8f9f-4a36-a2e2-b3f16e7c7ab8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 204 len: 0 microversion: 2.1 time: 0.543928 Jul 26 16:41:17.952221 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 422/826] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:41:17 2022] DELETE /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:41:17.961228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fb382a09-e406-47db-878e-f851f40c94f1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:17.961875 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fb382a09-e406-47db-878e-f851f40c94f1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:17.967849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fb382a09-e406-47db-878e-f851f40c94f1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:17.968315 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fb382a09-e406-47db-878e-f851f40c94f1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:17.969100 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fb382a09-e406-47db-878e-f851f40c94f1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:17.969536 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fb382a09-e406-47db-878e-f851f40c94f1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:18.103740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fb382a09-e406-47db-878e-f851f40c94f1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:18.111250 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fb382a09-e406-47db-878e-f851f40c94f1 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1686 microversion: 2.1 time: 0.153937 Jul 26 16:41:18.111813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 405/827] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:17 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:19.134942 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3d4b2b58-fb4e-44c4-a24b-6c1ac541fa41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:19.135758 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3d4b2b58-fb4e-44c4-a24b-6c1ac541fa41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:19.143477 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3d4b2b58-fb4e-44c4-a24b-6c1ac541fa41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:19.143929 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3d4b2b58-fb4e-44c4-a24b-6c1ac541fa41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:19.144874 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3d4b2b58-fb4e-44c4-a24b-6c1ac541fa41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:19.145313 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3d4b2b58-fb4e-44c4-a24b-6c1ac541fa41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:19.274627 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3d4b2b58-fb4e-44c4-a24b-6c1ac541fa41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:19.282346 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3d4b2b58-fb4e-44c4-a24b-6c1ac541fa41 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1686 microversion: 2.1 time: 0.152770 Jul 26 16:41:19.282906 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 423/828] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:19 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1686 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:20.306206 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4cf761db-5dcc-40e8-8cfd-f5583f08bb98 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:20.307689 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4cf761db-5dcc-40e8-8cfd-f5583f08bb98 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:20.314589 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4cf761db-5dcc-40e8-8cfd-f5583f08bb98 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:20.318348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4cf761db-5dcc-40e8-8cfd-f5583f08bb98 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:20.318348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4cf761db-5dcc-40e8-8cfd-f5583f08bb98 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:20.318348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4cf761db-5dcc-40e8-8cfd-f5583f08bb98 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:20.462822 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4cf761db-5dcc-40e8-8cfd-f5583f08bb98 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:20.470386 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4cf761db-5dcc-40e8-8cfd-f5583f08bb98 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1686 microversion: 2.1 time: 0.168529 Jul 26 16:41:20.484601 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 406/829] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:20 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:21.268960 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-ae63717c-bf70-4346-a1ac-688da8b636b6 req-0f17fe87-aee5-4e7a-a2df-6d8f0244cf62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c11953c-a484-4d00-a221-e03e55f46dc4", "name": "network-vif-deleted", "tag": "a0a91c54-eff1-4606-86a1-f907fac4dfa0"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:21.288011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-ae63717c-bf70-4346-a1ac-688da8b636b6 req-0f17fe87-aee5-4e7a-a2df-6d8f0244cf62 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:21.289026 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-ae63717c-bf70-4346-a1ac-688da8b636b6 req-0f17fe87-aee5-4e7a-a2df-6d8f0244cf62 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:21.299455 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-ae63717c-bf70-4346-a1ac-688da8b636b6 req-0f17fe87-aee5-4e7a-a2df-6d8f0244cf62 service nova] Creating event network-vif-deleted:a0a91c54-eff1-4606-86a1-f907fac4dfa0 for instance 5c11953c-a484-4d00-a221-e03e55f46dc4 on hv-cinder-85104 Jul 26 16:41:21.304823 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-ae63717c-bf70-4346-a1ac-688da8b636b6 req-0f17fe87-aee5-4e7a-a2df-6d8f0244cf62 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039488 Jul 26 16:41:21.305851 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 424/830] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:41:21.498676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a3950fbe-c14c-40ca-aa6a-36300274d943 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:21.499476 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a3950fbe-c14c-40ca-aa6a-36300274d943 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:21.506409 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a3950fbe-c14c-40ca-aa6a-36300274d943 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:21.506857 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a3950fbe-c14c-40ca-aa6a-36300274d943 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:21.507627 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a3950fbe-c14c-40ca-aa6a-36300274d943 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:21.508053 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a3950fbe-c14c-40ca-aa6a-36300274d943 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:21.575393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a3950fbe-c14c-40ca-aa6a-36300274d943 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:21.583081 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a3950fbe-c14c-40ca-aa6a-36300274d943 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1331 microversion: 2.1 time: 0.088200 Jul 26 16:41:21.584292 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 407/831] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:21 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:22.607227 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:22.607936 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:22.615358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:22.615815 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:22.616625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:22.617064 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:22.648698 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:22.649148 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:22.649602 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lazy-loading 'fault' on Instance uuid 5c11953c-a484-4d00-a221-e03e55f46dc4 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:41:22.692359 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:22.699988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2af3ef50-d024-4300-8ea4-158aac81e1e0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 200 len: 1336 microversion: 2.1 time: 0.097075 Jul 26 16:41:22.700754 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 425/832] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:22 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:23.721577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-98a26afe-727e-4567-a31d-394733e55245 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:23.722160 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-98a26afe-727e-4567-a31d-394733e55245 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:23.729138 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-98a26afe-727e-4567-a31d-394733e55245 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:23.729579 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-98a26afe-727e-4567-a31d-394733e55245 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:23.730327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-98a26afe-727e-4567-a31d-394733e55245 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:23.730758 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-98a26afe-727e-4567-a31d-394733e55245 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:23.744359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-98a26afe-727e-4567-a31d-394733e55245 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-98a26afe-727e-4567-a31d-394733e55245 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 HTTP/1.1 Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:41:23.745853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:41:23.747426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '5c11953c-a484-4d00-a221-e03e55f46dc4'} Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:41:23.748328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:41:23.749849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:23.751191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-98a26afe-727e-4567-a31d-394733e55245 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:41:23.751191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-98a26afe-727e-4567-a31d-394733e55245 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 404 len: 111 microversion: 2.1 time: 0.029521 Jul 26 16:41:23.751191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 408/833] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:23 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:41:23.756048 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8888f682-c073-427f-b686-20072dcb06de tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '.version_select at 0x7f4b6c07e280>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:23.861313 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8888f682-c073-427f-b686-20072dcb06de tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900774415" status: 202 len: 0 microversion: 2.1 time: 0.108816 Jul 26 16:41:23.861905 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 426/834] 10.222.0.144 () {58 vars in 1226 bytes} [Tue Jul 26 16:41:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900774415 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:41:24.770182 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-42eaa418-8150-44bb-82b9-db24cb93697c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: .version_select at 0x7f4b6778d4c0>, body: {"keypair": {"name": "tempest-keypair-2056727071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIOMSb0Xn5WhU0vhwNbNeVpXrViERKW2z7FydzCCxO1mptz3plvRYWTcwg/6gCvU5gSLWRsTVbAFLIm03GonHOctAjsYJ5wco7zYhmFEeQHOJylxuFNqNvNOloBCH7V9Gw=="}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:24.786330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-42eaa418-8150-44bb-82b9-db24cb93697c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for project 8bb1d794693b410d8c759796d5e20281. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:41:24.790614 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-42eaa418-8150-44bb-82b9-db24cb93697c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for user 4c6fffcc3c0d4c49848fa6c2f6b90130 and project 8bb1d794693b410d8c759796d5e20281. Resources: {'key_pairs'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:41:24.986856 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-42eaa418-8150-44bb-82b9-db24cb93697c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.220825 Jul 26 16:41:24.987454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 409/835] 10.222.0.144 () {60 vars in 1164 bytes} [Tue Jul 26 16:41:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:41:28.277269 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1580660678", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7fec62f0-42f9-4a76-8f36-14730e310aa9"}], "security_groups": [{"name": "tempest-securitygroup--1734303437"}], "key_name": "tempest-keypair-2056727071", "user_data": "}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:28.376633 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] validate_networks() for [('7fec62f0-42f9-4a76-8f36-14730e310aa9', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:41:28.741621 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:41:28.742044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:41:28.742519 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:41:28.742933 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:41:28.743340 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:41:28.752181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:28.752659 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:28.753660 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:28.754097 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:28.771415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for project 8bb1d794693b410d8c759796d5e20281. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:41:28.775333 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Getting quotas for user 4c6fffcc3c0d4c49848fa6c2f6b90130 and project 8bb1d794693b410d8c759796d5e20281. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:41:28.786342 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:41:28.788594 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:41:28.964735 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5d0cbecc-5b5c-46c3-a14d-f985fd35438a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.692352 Jul 26 16:41:28.965378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 427/836] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:41:28 2022] POST /compute/v2.1/servers => generated 404 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:41:28.977668 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9dc9fcf6-45ac-4971-a2ce-f985ccea5631 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:28.978286 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9dc9fcf6-45ac-4971-a2ce-f985ccea5631 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:29.037716 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9dc9fcf6-45ac-4971-a2ce-f985ccea5631 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:29.044417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9dc9fcf6-45ac-4971-a2ce-f985ccea5631 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1246 microversion: 2.1 time: 0.071747 Jul 26 16:41:29.044988 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 410/837] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:28 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:30.065756 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f2c65bae-6e14-403f-bf07-fcd44bde12cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:30.066364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f2c65bae-6e14-403f-bf07-fcd44bde12cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:30.121997 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f2c65bae-6e14-403f-bf07-fcd44bde12cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:30.124930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f2c65bae-6e14-403f-bf07-fcd44bde12cd tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1246 microversion: 2.1 time: 0.063700 Jul 26 16:41:30.125486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 428/838] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:30 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1246 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:31.145675 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e91d4ea8-1c11-426e-89e7-71672b5ac307 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:31.146991 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e91d4ea8-1c11-426e-89e7-71672b5ac307 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:31.153783 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e91d4ea8-1c11-426e-89e7-71672b5ac307 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:31.154270 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e91d4ea8-1c11-426e-89e7-71672b5ac307 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:31.155309 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e91d4ea8-1c11-426e-89e7-71672b5ac307 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:31.155745 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e91d4ea8-1c11-426e-89e7-71672b5ac307 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:31.254588 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e91d4ea8-1c11-426e-89e7-71672b5ac307 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:31.262098 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e91d4ea8-1c11-426e-89e7-71672b5ac307 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1242 microversion: 2.1 time: 0.120281 Jul 26 16:41:31.262663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 411/839] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:31 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:32.145284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2bdf3d12-95ac-4507-acff-b87611fde1e1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:32.145891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2bdf3d12-95ac-4507-acff-b87611fde1e1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:32.153200 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-e545716b-8060-47a5-8b1f-cf40440aa720 req-2838a6e5-3edb-4d4c-a411-6a1b806203be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "976970b3-530e-4bc0-a609-bc3d8ac750a8", "tag": "e562fcc8-f654-4575-a60e-9fafbe61bfee"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:32.177170 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2bdf3d12-95ac-4507-acff-b87611fde1e1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:32.183893 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-e545716b-8060-47a5-8b1f-cf40440aa720 req-2838a6e5-3edb-4d4c-a411-6a1b806203be service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:32.183893 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-e545716b-8060-47a5-8b1f-cf40440aa720 req-2838a6e5-3edb-4d4c-a411-6a1b806203be service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:32.184890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2bdf3d12-95ac-4507-acff-b87611fde1e1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:32.185724 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2bdf3d12-95ac-4507-acff-b87611fde1e1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:32.186163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2bdf3d12-95ac-4507-acff-b87611fde1e1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:32.211662 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-e545716b-8060-47a5-8b1f-cf40440aa720 req-2838a6e5-3edb-4d4c-a411-6a1b806203be service nova] Creating event network-changed:e562fcc8-f654-4575-a60e-9fafbe61bfee for instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 on hv-cinder-85104 Jul 26 16:41:32.213385 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2bdf3d12-95ac-4507-acff-b87611fde1e1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Going to try to terminate instance {{(pid=124821) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:41:32.217133 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-e545716b-8060-47a5-8b1f-cf40440aa720 req-2838a6e5-3edb-4d4c-a411-6a1b806203be service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067289 Jul 26 16:41:32.217936 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 412/840] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:41:32.284201 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-37127ccb-30d0-46c5-8d49-2577b7abca82 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:32.285075 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-37127ccb-30d0-46c5-8d49-2577b7abca82 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:32.292168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37127ccb-30d0-46c5-8d49-2577b7abca82 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:32.292659 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37127ccb-30d0-46c5-8d49-2577b7abca82 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:32.293448 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37127ccb-30d0-46c5-8d49-2577b7abca82 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:32.293887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37127ccb-30d0-46c5-8d49-2577b7abca82 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:32.401515 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-37127ccb-30d0-46c5-8d49-2577b7abca82 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:32.432492 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-37127ccb-30d0-46c5-8d49-2577b7abca82 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1306 microversion: 2.1 time: 0.152949 Jul 26 16:41:32.437322 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 413/841] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:32 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1306 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:41:32.780433 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2bdf3d12-95ac-4507-acff-b87611fde1e1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "DELETE /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 204 len: 0 microversion: 2.1 time: 0.638509 Jul 26 16:41:32.781021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 429/842] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:41:32 2022] DELETE /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:41:32.789262 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1cc17efd-282a-4d65-bfb9-0d762f2b31da tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:32.789977 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1cc17efd-282a-4d65-bfb9-0d762f2b31da tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:32.795883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1cc17efd-282a-4d65-bfb9-0d762f2b31da tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:32.796341 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1cc17efd-282a-4d65-bfb9-0d762f2b31da tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:32.797170 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1cc17efd-282a-4d65-bfb9-0d762f2b31da tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:32.797615 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1cc17efd-282a-4d65-bfb9-0d762f2b31da tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:32.935873 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1cc17efd-282a-4d65-bfb9-0d762f2b31da tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:32.944802 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1cc17efd-282a-4d65-bfb9-0d762f2b31da tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.159371 Jul 26 16:41:32.945636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 414/843] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:32 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:33.458963 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dd7f1758-7e15-4b3d-a07b-cb3b2b067f2a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:33.459870 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dd7f1758-7e15-4b3d-a07b-cb3b2b067f2a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:33.466167 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dd7f1758-7e15-4b3d-a07b-cb3b2b067f2a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:33.466618 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dd7f1758-7e15-4b3d-a07b-cb3b2b067f2a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:33.467383 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dd7f1758-7e15-4b3d-a07b-cb3b2b067f2a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:33.467819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dd7f1758-7e15-4b3d-a07b-cb3b2b067f2a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:33.596049 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-dd7f1758-7e15-4b3d-a07b-cb3b2b067f2a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:33.604092 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dd7f1758-7e15-4b3d-a07b-cb3b2b067f2a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1372 microversion: 2.1 time: 0.149901 Jul 26 16:41:33.604689 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 430/844] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:33 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:33.967381 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7ed63338-0131-492c-8112-d01a2e5912f2 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:33.971685 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7ed63338-0131-492c-8112-d01a2e5912f2 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:33.975295 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7ed63338-0131-492c-8112-d01a2e5912f2 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:33.975875 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7ed63338-0131-492c-8112-d01a2e5912f2 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:33.976874 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7ed63338-0131-492c-8112-d01a2e5912f2 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:33.977537 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7ed63338-0131-492c-8112-d01a2e5912f2 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:34.129709 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7ed63338-0131-492c-8112-d01a2e5912f2 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:34.137858 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7ed63338-0131-492c-8112-d01a2e5912f2 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1572 microversion: 2.1 time: 0.174644 Jul 26 16:41:34.138423 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 415/845] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:33 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1572 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:34.625507 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-85bff3a0-e4d9-4cbb-8094-255207e6bd4c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:34.627273 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-85bff3a0-e4d9-4cbb-8094-255207e6bd4c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:34.633886 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-85bff3a0-e4d9-4cbb-8094-255207e6bd4c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:34.634338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-85bff3a0-e4d9-4cbb-8094-255207e6bd4c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:34.635231 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-85bff3a0-e4d9-4cbb-8094-255207e6bd4c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:34.635705 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-85bff3a0-e4d9-4cbb-8094-255207e6bd4c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:34.769441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-85bff3a0-e4d9-4cbb-8094-255207e6bd4c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:34.777420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-85bff3a0-e4d9-4cbb-8094-255207e6bd4c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1372 microversion: 2.1 time: 0.155936 Jul 26 16:41:34.777903 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 431/846] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:34 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:34.849669 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-bc70ed76-c189-42de-ae0b-6a19a4723361 req-03942f99-a000-437b-a46d-6cb012e97f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3537f9da-57c2-4c3d-a733-98a467c4ca30", "tag": "ff83ae02-6aed-4b08-a74a-deeb7a1cb522"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:34.860191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-bc70ed76-c189-42de-ae0b-6a19a4723361 req-03942f99-a000-437b-a46d-6cb012e97f54 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:34.860806 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-bc70ed76-c189-42de-ae0b-6a19a4723361 req-03942f99-a000-437b-a46d-6cb012e97f54 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:34.872762 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-bc70ed76-c189-42de-ae0b-6a19a4723361 req-03942f99-a000-437b-a46d-6cb012e97f54 service nova] Creating event network-changed:ff83ae02-6aed-4b08-a74a-deeb7a1cb522 for instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 on hv-cinder-85104 Jul 26 16:41:34.877939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-bc70ed76-c189-42de-ae0b-6a19a4723361 req-03942f99-a000-437b-a46d-6cb012e97f54 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032648 Jul 26 16:41:34.878791 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 416/847] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:41:35.163325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cb43dd8f-78d5-473e-9abd-a9213ab5b4bc tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:35.163921 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-cb43dd8f-78d5-473e-9abd-a9213ab5b4bc tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:35.183711 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cb43dd8f-78d5-473e-9abd-a9213ab5b4bc tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:35.183711 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cb43dd8f-78d5-473e-9abd-a9213ab5b4bc tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:35.183711 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cb43dd8f-78d5-473e-9abd-a9213ab5b4bc tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:35.183711 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cb43dd8f-78d5-473e-9abd-a9213ab5b4bc tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:35.339457 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-cb43dd8f-78d5-473e-9abd-a9213ab5b4bc tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:35.347022 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-cb43dd8f-78d5-473e-9abd-a9213ab5b4bc tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1453 microversion: 2.1 time: 0.187715 Jul 26 16:41:35.347586 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 432/848] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:35 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1453 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:35.799549 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e0524125-15a8-461c-88ea-c493f7244a21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:35.800245 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e0524125-15a8-461c-88ea-c493f7244a21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:35.808476 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e0524125-15a8-461c-88ea-c493f7244a21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:35.808937 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e0524125-15a8-461c-88ea-c493f7244a21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:35.809711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e0524125-15a8-461c-88ea-c493f7244a21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:35.810148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e0524125-15a8-461c-88ea-c493f7244a21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:35.953237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e0524125-15a8-461c-88ea-c493f7244a21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:35.960710 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e0524125-15a8-461c-88ea-c493f7244a21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1372 microversion: 2.1 time: 0.165770 Jul 26 16:41:35.961282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 417/849] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:35 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:36.367207 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-65eec17c-0c05-490e-a481-385db754ac99 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:36.367812 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-65eec17c-0c05-490e-a481-385db754ac99 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:36.374334 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-65eec17c-0c05-490e-a481-385db754ac99 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:36.374779 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-65eec17c-0c05-490e-a481-385db754ac99 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:36.375527 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-65eec17c-0c05-490e-a481-385db754ac99 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:36.375955 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-65eec17c-0c05-490e-a481-385db754ac99 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:36.436065 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-65eec17c-0c05-490e-a481-385db754ac99 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:36.443391 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-65eec17c-0c05-490e-a481-385db754ac99 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1385 microversion: 2.1 time: 0.080120 Jul 26 16:41:36.443958 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 433/850] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:36 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:36.893756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-22dd3f34-634d-4fdc-95c9-91acdb8af882 req-4f242793-d037-491e-a1c0-f597bbd6d13d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "976970b3-530e-4bc0-a609-bc3d8ac750a8", "name": "network-vif-deleted", "tag": "e562fcc8-f654-4575-a60e-9fafbe61bfee"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:36.903475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-22dd3f34-634d-4fdc-95c9-91acdb8af882 req-4f242793-d037-491e-a1c0-f597bbd6d13d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:36.903918 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-22dd3f34-634d-4fdc-95c9-91acdb8af882 req-4f242793-d037-491e-a1c0-f597bbd6d13d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:36.917007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-22dd3f34-634d-4fdc-95c9-91acdb8af882 req-4f242793-d037-491e-a1c0-f597bbd6d13d service nova] Creating event network-vif-deleted:e562fcc8-f654-4575-a60e-9fafbe61bfee for instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 on hv-cinder-85104 Jul 26 16:41:36.921663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-22dd3f34-634d-4fdc-95c9-91acdb8af882 req-4f242793-d037-491e-a1c0-f597bbd6d13d service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031584 Jul 26 16:41:36.922226 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 418/851] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:41:36.981591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-bfa0a546-ad76-4e46-a0c1-898645de9afe tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:36.982267 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-bfa0a546-ad76-4e46-a0c1-898645de9afe tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:36.988526 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bfa0a546-ad76-4e46-a0c1-898645de9afe tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:36.988971 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bfa0a546-ad76-4e46-a0c1-898645de9afe tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:36.989723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bfa0a546-ad76-4e46-a0c1-898645de9afe tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:36.990153 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bfa0a546-ad76-4e46-a0c1-898645de9afe tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:37.120149 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-bfa0a546-ad76-4e46-a0c1-898645de9afe tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:37.128751 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-bfa0a546-ad76-4e46-a0c1-898645de9afe tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1372 microversion: 2.1 time: 0.151212 Jul 26 16:41:37.130991 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 434/852] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:36 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:37.464870 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-14d8ee82-df12-4bfd-8534-bdfe203babd1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:37.465562 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-14d8ee82-df12-4bfd-8534-bdfe203babd1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:37.471798 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-14d8ee82-df12-4bfd-8534-bdfe203babd1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:37.472242 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-14d8ee82-df12-4bfd-8534-bdfe203babd1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:37.473018 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-14d8ee82-df12-4bfd-8534-bdfe203babd1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:37.473447 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-14d8ee82-df12-4bfd-8534-bdfe203babd1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:37.543648 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-14d8ee82-df12-4bfd-8534-bdfe203babd1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:37.551054 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-14d8ee82-df12-4bfd-8534-bdfe203babd1 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1385 microversion: 2.1 time: 0.090313 Jul 26 16:41:37.551615 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 419/853] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:37 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1385 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:38.158166 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1263c170-efd6-4b68-aa45-bcb712b4d79f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:38.158799 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1263c170-efd6-4b68-aa45-bcb712b4d79f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:38.165227 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1263c170-efd6-4b68-aa45-bcb712b4d79f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:38.165673 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1263c170-efd6-4b68-aa45-bcb712b4d79f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:38.166423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1263c170-efd6-4b68-aa45-bcb712b4d79f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:38.166851 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1263c170-efd6-4b68-aa45-bcb712b4d79f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:38.184906 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:38.296980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1263c170-efd6-4b68-aa45-bcb712b4d79f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:38.304828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1263c170-efd6-4b68-aa45-bcb712b4d79f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1372 microversion: 2.1 time: 0.150812 Jul 26 16:41:38.310675 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 435/854] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:38 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:38.571821 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2007d296-0077-4794-a214-976612bd780d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:38.572465 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2007d296-0077-4794-a214-976612bd780d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:38.578852 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2007d296-0077-4794-a214-976612bd780d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:38.579303 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2007d296-0077-4794-a214-976612bd780d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:38.580060 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2007d296-0077-4794-a214-976612bd780d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:38.580520 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2007d296-0077-4794-a214-976612bd780d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:38.641833 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2007d296-0077-4794-a214-976612bd780d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:38.649994 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2007d296-0077-4794-a214-976612bd780d tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1385 microversion: 2.1 time: 0.082133 Jul 26 16:41:38.650558 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 420/855] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:38 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1385 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:39.327288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5c91663b-1d77-4498-b6b8-0f54876e038b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:39.327894 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5c91663b-1d77-4498-b6b8-0f54876e038b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:39.329667 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:39.335252 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5c91663b-1d77-4498-b6b8-0f54876e038b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:39.335692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5c91663b-1d77-4498-b6b8-0f54876e038b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:39.336463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5c91663b-1d77-4498-b6b8-0f54876e038b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:39.336900 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5c91663b-1d77-4498-b6b8-0f54876e038b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:39.476346 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5c91663b-1d77-4498-b6b8-0f54876e038b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:39.483944 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5c91663b-1d77-4498-b6b8-0f54876e038b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1372 microversion: 2.1 time: 0.160835 Jul 26 16:41:39.484520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 436/856] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:39 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:39.671366 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e389a63f-586d-48ae-adcf-33c1b24cd568 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:39.671971 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e389a63f-586d-48ae-adcf-33c1b24cd568 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:39.673969 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=6 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:39.679708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e389a63f-586d-48ae-adcf-33c1b24cd568 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:39.680155 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e389a63f-586d-48ae-adcf-33c1b24cd568 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:39.680986 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e389a63f-586d-48ae-adcf-33c1b24cd568 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:39.681421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e389a63f-586d-48ae-adcf-33c1b24cd568 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:39.745118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e389a63f-586d-48ae-adcf-33c1b24cd568 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:39.752533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e389a63f-586d-48ae-adcf-33c1b24cd568 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1221 microversion: 2.1 time: 0.085036 Jul 26 16:41:39.753095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 421/857] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:39 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1221 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:40.506436 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2c3e7d90-edd5-42fa-8a53-64f7a6e8a5d0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:40.507453 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2c3e7d90-edd5-42fa-8a53-64f7a6e8a5d0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:40.510893 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=8 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:40.516768 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2c3e7d90-edd5-42fa-8a53-64f7a6e8a5d0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:40.517216 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2c3e7d90-edd5-42fa-8a53-64f7a6e8a5d0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:40.517986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2c3e7d90-edd5-42fa-8a53-64f7a6e8a5d0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:40.518422 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2c3e7d90-edd5-42fa-8a53-64f7a6e8a5d0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:40.759799 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2c3e7d90-edd5-42fa-8a53-64f7a6e8a5d0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:40.772210 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2c3e7d90-edd5-42fa-8a53-64f7a6e8a5d0 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1372 microversion: 2.1 time: 0.271146 Jul 26 16:41:40.773841 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:40.774468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:40.783174 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:40.783840 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:40.785126 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:40.785647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 437/858] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:40 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1372 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:40.785766 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:40.809434 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:40.830790 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:40.831249 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:40.831884 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lazy-loading 'fault' on Instance uuid 976970b3-530e-4bc0-a609-bc3d8ac750a8 {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:41:40.887639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b089f2cc22449329110fd3cfafecd53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22e3bf7bb6ef4ca8bb2353bdfe4e90a3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:40.896542 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e418dcf1-19d0-4eef-8184-4f5289c0142c tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 200 len: 1226 microversion: 2.1 time: 0.126423 Jul 26 16:41:40.897143 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 422/859] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:40 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 1226 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:41:41.794504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4f963d82-3fea-4a03-86ba-fa5183c61215 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:41.795153 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4f963d82-3fea-4a03-86ba-fa5183c61215 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:41.802625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4f963d82-3fea-4a03-86ba-fa5183c61215 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:41.803079 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4f963d82-3fea-4a03-86ba-fa5183c61215 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:41.803853 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4f963d82-3fea-4a03-86ba-fa5183c61215 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:41.804284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4f963d82-3fea-4a03-86ba-fa5183c61215 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:41.918959 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b5f4d759-5cd9-4693-a486-e81d792611ad tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:41.919615 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b5f4d759-5cd9-4693-a486-e81d792611ad tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] [instance: 976970b3-530e-4bc0-a609-bc3d8ac750a8] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:41.926864 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b5f4d759-5cd9-4693-a486-e81d792611ad tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:41.932619 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b5f4d759-5cd9-4693-a486-e81d792611ad tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:41.932619 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b5f4d759-5cd9-4693-a486-e81d792611ad tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:41.932619 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b5f4d759-5cd9-4693-a486-e81d792611ad tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:41.935675 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4f963d82-3fea-4a03-86ba-fa5183c61215 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:41.943261 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4f963d82-3fea-4a03-86ba-fa5183c61215 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1372 microversion: 2.1 time: 0.152535 Jul 26 16:41:41.946279 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-b5f4d759-5cd9-4693-a486-e81d792611ad tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] HTTP exception thrown: Instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 could not be found. Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b5f4d759-5cd9-4693-a486-e81d792611ad tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Request method failure captured: Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 HTTP/1.1 Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BfE3AEfjAXDiH2chtxoAE8Z3Hd5BklRvyfZcjPDUEu0cZNYhMu0bttsOPTOCe4Dv0ZkKvYNqyrs7FZc6YiPfxzHa03wpf_ccWwHmGx5XhqyZ3GU5nGSiNIHHKz8yx8qqaXs6p-NgS33wauAaLi8pDs2738skUtIIeEuESXsR4MNC8I Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 22e3bf7bb6ef4ca8bb2353bdfe4e90a3 Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-TestShelveInstance-739317822 Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:41:41.948241 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/22e3bf7bb6ef4ca8bb2353bdfe4e90a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/22e3bf7bb6ef4ca8bb2353bdfe4e90a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/22e3bf7bb6ef4ca8bb2353bdfe4e90a3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_22e3bf7bb6ef4ca8bb2353bdfe4e90a3", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-TestShelveInstance-739317822 Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 22e3bf7bb6ef4ca8bb2353bdfe4e90a3 Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-TestShelveInstance-739317822 Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-TestShelveInstance-739317822-project Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 3b089f2cc22449329110fd3cfafecd53 Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-TestShelveInstance-739317822-project Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 could not be found. Jul 26 16:41:41.949829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '976970b3-530e-4bc0-a609-bc3d8ac750a8'} Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 could not be found. Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:41:41.950620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 could not be found. Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 could not be found. Jul 26 16:41:41.952255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:41:41.953975 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b5f4d759-5cd9-4693-a486-e81d792611ad tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Returning 404 to user: Instance 976970b3-530e-4bc0-a609-bc3d8ac750a8 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:41:41.953975 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b5f4d759-5cd9-4693-a486-e81d792611ad tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8" status: 404 len: 111 microversion: 2.1 time: 0.034841 Jul 26 16:41:41.953975 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 423/860] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:41 2022] GET /compute/v2.1/servers/976970b3-530e-4bc0-a609-bc3d8ac750a8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 16:41:41.956377 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 438/861] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:41 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:42.231039 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cbfd3897-f3e2-4eda-89c0-d5e0643e24a2 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] Calling method '.version_select at 0x7f4b6e127dc0>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:42.375916 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cbfd3897-f3e2-4eda-89c0-d5e0643e24a2 tempest-TestShelveInstance-739317822 tempest-TestShelveInstance-739317822-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-760029829" status: 202 len: 0 microversion: 2.1 time: 0.149007 Jul 26 16:41:42.376517 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 424/862] 10.222.0.144 () {58 vars in 1256 bytes} [Tue Jul 26 16:41:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-760029829 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:41:42.964229 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5dbd0c3a-8a6b-4e9d-8833-db4babb0bfb9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:42.965415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5dbd0c3a-8a6b-4e9d-8833-db4babb0bfb9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:42.972482 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5dbd0c3a-8a6b-4e9d-8833-db4babb0bfb9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:42.973199 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5dbd0c3a-8a6b-4e9d-8833-db4babb0bfb9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:42.974027 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5dbd0c3a-8a6b-4e9d-8833-db4babb0bfb9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:42.974564 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5dbd0c3a-8a6b-4e9d-8833-db4babb0bfb9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:43.001489 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-fab6eb87-0f08-4fb1-8340-165a05fddef4 req-350720df-72e1-4fb9-8a61-fc3efc5f6a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3537f9da-57c2-4c3d-a733-98a467c4ca30", "name": "network-vif-plugged", "status": "completed", "tag": "ff83ae02-6aed-4b08-a74a-deeb7a1cb522"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:43.014573 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-fab6eb87-0f08-4fb1-8340-165a05fddef4 req-350720df-72e1-4fb9-8a61-fc3efc5f6a99 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:43.015255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-fab6eb87-0f08-4fb1-8340-165a05fddef4 req-350720df-72e1-4fb9-8a61-fc3efc5f6a99 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:43.026244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-fab6eb87-0f08-4fb1-8340-165a05fddef4 req-350720df-72e1-4fb9-8a61-fc3efc5f6a99 service nova] Creating event network-vif-plugged:ff83ae02-6aed-4b08-a74a-deeb7a1cb522 for instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 on hv-cinder-85104 Jul 26 16:41:43.031612 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-fab6eb87-0f08-4fb1-8340-165a05fddef4 req-350720df-72e1-4fb9-8a61-fc3efc5f6a99 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035029 Jul 26 16:41:43.033179 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 425/863] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:41:43.198115 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5dbd0c3a-8a6b-4e9d-8833-db4babb0bfb9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:43.206761 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5dbd0c3a-8a6b-4e9d-8833-db4babb0bfb9 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1372 microversion: 2.1 time: 0.246714 Jul 26 16:41:43.207378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 439/864] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:42 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1372 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:44.228311 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b840358d-495f-4e37-92fa-56bf256000df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:44.229703 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b840358d-495f-4e37-92fa-56bf256000df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:44.237999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b840358d-495f-4e37-92fa-56bf256000df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:44.238618 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b840358d-495f-4e37-92fa-56bf256000df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:44.239649 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b840358d-495f-4e37-92fa-56bf256000df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:44.240149 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b840358d-495f-4e37-92fa-56bf256000df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:44.377007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b840358d-495f-4e37-92fa-56bf256000df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:44.385148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b840358d-495f-4e37-92fa-56bf256000df tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1372 microversion: 2.1 time: 0.161595 Jul 26 16:41:44.385719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 426/865] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:44 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:45.413101 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7fe963b0-dae8-46bd-859b-f265ff242e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:45.413101 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7fe963b0-dae8-46bd-859b-f265ff242e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:45.413101 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:45.417364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7fe963b0-dae8-46bd-859b-f265ff242e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:45.417676 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7fe963b0-dae8-46bd-859b-f265ff242e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:45.418452 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7fe963b0-dae8-46bd-859b-f265ff242e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:45.418886 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7fe963b0-dae8-46bd-859b-f265ff242e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:45.636958 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7fe963b0-dae8-46bd-859b-f265ff242e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:45.644446 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7fe963b0-dae8-46bd-859b-f265ff242e9b tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1562 microversion: 2.1 time: 0.241292 Jul 26 16:41:45.645015 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 440/866] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:45 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:45.666287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bdd5c68b-60f1-4af1-8ce5-6faa08365783 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:45.666796 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bdd5c68b-60f1-4af1-8ce5-6faa08365783 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:45.669362 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:45.674622 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bdd5c68b-60f1-4af1-8ce5-6faa08365783 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:45.675268 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bdd5c68b-60f1-4af1-8ce5-6faa08365783 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:45.676266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bdd5c68b-60f1-4af1-8ce5-6faa08365783 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:45.676737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bdd5c68b-60f1-4af1-8ce5-6faa08365783 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:45.761628 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bdd5c68b-60f1-4af1-8ce5-6faa08365783 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100452 Jul 26 16:41:45.762248 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 427/867] 10.222.0.144 () {58 vars in 1280 bytes} [Tue Jul 26 16:41:45 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:41:46.942168 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-678df76e-e8ca-43b3-8aeb-08b7434a9cde req-61644346-de07-441e-abf8-2e5e039fbfb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3537f9da-57c2-4c3d-a733-98a467c4ca30", "tag": "ff83ae02-6aed-4b08-a74a-deeb7a1cb522"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:46.953001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-678df76e-e8ca-43b3-8aeb-08b7434a9cde req-61644346-de07-441e-abf8-2e5e039fbfb3 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:46.953443 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-678df76e-e8ca-43b3-8aeb-08b7434a9cde req-61644346-de07-441e-abf8-2e5e039fbfb3 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:46.965712 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-678df76e-e8ca-43b3-8aeb-08b7434a9cde req-61644346-de07-441e-abf8-2e5e039fbfb3 service nova] Creating event network-changed:ff83ae02-6aed-4b08-a74a-deeb7a1cb522 for instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 on hv-cinder-85104 Jul 26 16:41:46.972184 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-678df76e-e8ca-43b3-8aeb-08b7434a9cde req-61644346-de07-441e-abf8-2e5e039fbfb3 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033685 Jul 26 16:41:46.974089 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 441/868] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:41:54.955157 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1385330103", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "networks": [{"uuid": "72cf3937-9e4d-41cc-b20a-bd33e5507cd9"}]}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:41:55.006001 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.network.neutron [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] validate_networks() for [('72cf3937-9e4d-41cc-b20a-bd33e5507cd9', None, None, None, None, None)] {{(pid=124820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:41:55.639462 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Flavor limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:41:55.639886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Image limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:41:55.640471 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Flavor pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:41:55.645972 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Image pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:41:55.645972 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:41:55.650513 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:55.650964 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:55.651763 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:55.652206 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:55.670330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Getting quotas for project ba880373700044f08ba1adbdb416fb55. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:41:55.674256 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Getting quotas for user af63552b750f4160a257596e3e0f5669 and project ba880373700044f08ba1adbdb416fb55. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:41:55.684954 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Going to run 1 instances... {{(pid=124820) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:41:55.687363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:41:55.953488 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-31061e25-21e8-42f8-8a7e-430a620d2b05 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.002878 Jul 26 16:41:55.954359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 428/869] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:41:54 2022] POST /compute/v2.1/servers => generated 382 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:41:55.965506 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-eb6a2e70-4231-4634-8600-63156e2ea414 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:55.967445 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-eb6a2e70-4231-4634-8600-63156e2ea414 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:56.042613 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-eb6a2e70-4231-4634-8600-63156e2ea414 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:56.048974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-eb6a2e70-4231-4634-8600-63156e2ea414 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1223 microversion: 2.1 time: 0.087224 Jul 26 16:41:56.056426 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 442/870] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:55 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:41:57.070351 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c491d628-c83d-4b32-b7d4-0af70b3d063a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:57.072059 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c491d628-c83d-4b32-b7d4-0af70b3d063a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:57.131326 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c491d628-c83d-4b32-b7d4-0af70b3d063a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:57.139820 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c491d628-c83d-4b32-b7d4-0af70b3d063a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1223 microversion: 2.1 time: 0.073517 Jul 26 16:41:57.140210 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 429/871] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:57 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1223 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:58.161531 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-32abf08e-399f-4d52-ae5f-c3e3f742c8b8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:58.162140 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-32abf08e-399f-4d52-ae5f-c3e3f742c8b8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:58.164217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=34 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:41:58.175982 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32abf08e-399f-4d52-ae5f-c3e3f742c8b8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:58.176462 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32abf08e-399f-4d52-ae5f-c3e3f742c8b8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:58.177262 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32abf08e-399f-4d52-ae5f-c3e3f742c8b8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:58.177697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-32abf08e-399f-4d52-ae5f-c3e3f742c8b8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:58.273820 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-32abf08e-399f-4d52-ae5f-c3e3f742c8b8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:58.284309 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-32abf08e-399f-4d52-ae5f-c3e3f742c8b8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1227 microversion: 2.1 time: 0.126865 Jul 26 16:41:58.285140 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 443/872] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:58 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1227 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:41:59.305498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fa685c84-406a-4461-9d17-e71130047054 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:41:59.306175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fa685c84-406a-4461-9d17-e71130047054 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:41:59.314604 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa685c84-406a-4461-9d17-e71130047054 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:59.315336 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa685c84-406a-4461-9d17-e71130047054 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:59.316300 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa685c84-406a-4461-9d17-e71130047054 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:41:59.316906 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa685c84-406a-4461-9d17-e71130047054 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:41:59.387508 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fa685c84-406a-4461-9d17-e71130047054 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:41:59.397310 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fa685c84-406a-4461-9d17-e71130047054 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1283 microversion: 2.1 time: 0.096050 Jul 26 16:41:59.408467 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 430/873] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:41:59 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:00.420690 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-15012483-8add-4e86-92c2-dc1c5cca22e9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:00.421305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-15012483-8add-4e86-92c2-dc1c5cca22e9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:00.432779 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-15012483-8add-4e86-92c2-dc1c5cca22e9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:00.433818 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-15012483-8add-4e86-92c2-dc1c5cca22e9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:00.434896 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-15012483-8add-4e86-92c2-dc1c5cca22e9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:00.435661 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-15012483-8add-4e86-92c2-dc1c5cca22e9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:00.642395 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-15012483-8add-4e86-92c2-dc1c5cca22e9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:00.650465 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-15012483-8add-4e86-92c2-dc1c5cca22e9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.234543 Jul 26 16:42:00.651042 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 444/874] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:00 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:01.497270 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-aef55cea-d56b-4d49-bde4-369489165efa req-4c751129-2478-4a33-ab48-ecf7403df484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee309e14-b43f-4f0f-98dc-ce5222fb9140", "tag": "4bed39fa-7b38-4cfd-8ad4-4d313219fd2b"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:42:01.509729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-aef55cea-d56b-4d49-bde4-369489165efa req-4c751129-2478-4a33-ab48-ecf7403df484 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:01.510183 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-aef55cea-d56b-4d49-bde4-369489165efa req-4c751129-2478-4a33-ab48-ecf7403df484 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:01.526022 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-aef55cea-d56b-4d49-bde4-369489165efa req-4c751129-2478-4a33-ab48-ecf7403df484 service nova] Creating event network-changed:4bed39fa-7b38-4cfd-8ad4-4d313219fd2b for instance ee309e14-b43f-4f0f-98dc-ce5222fb9140 on hv-cinder-85104 Jul 26 16:42:01.528869 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-aef55cea-d56b-4d49-bde4-369489165efa req-4c751129-2478-4a33-ab48-ecf7403df484 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036014 Jul 26 16:42:01.529993 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 431/875] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:42:01.673358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e4b9e3b7-d011-47b2-8d87-4d566d55a1f0 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:01.673975 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e4b9e3b7-d011-47b2-8d87-4d566d55a1f0 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:01.684381 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e4b9e3b7-d011-47b2-8d87-4d566d55a1f0 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:01.684852 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e4b9e3b7-d011-47b2-8d87-4d566d55a1f0 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:01.685653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e4b9e3b7-d011-47b2-8d87-4d566d55a1f0 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:01.686093 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e4b9e3b7-d011-47b2-8d87-4d566d55a1f0 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:01.925915 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e4b9e3b7-d011-47b2-8d87-4d566d55a1f0 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:01.936318 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e4b9e3b7-d011-47b2-8d87-4d566d55a1f0 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.266680 Jul 26 16:42:01.937230 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 445/876] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:01 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:02.957912 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ec26bec9-6b9c-439e-a5a4-6389c61dc395 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:02.958607 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ec26bec9-6b9c-439e-a5a4-6389c61dc395 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:02.964947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ec26bec9-6b9c-439e-a5a4-6389c61dc395 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:02.965389 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ec26bec9-6b9c-439e-a5a4-6389c61dc395 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:02.966151 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ec26bec9-6b9c-439e-a5a4-6389c61dc395 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:02.966636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ec26bec9-6b9c-439e-a5a4-6389c61dc395 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:03.159954 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ec26bec9-6b9c-439e-a5a4-6389c61dc395 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:03.168363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ec26bec9-6b9c-439e-a5a4-6389c61dc395 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.215264 Jul 26 16:42:03.169104 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 432/877] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:02 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:04.190417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f0424e83-dc88-4e3b-8f0a-07d45a16a13f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:04.191124 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f0424e83-dc88-4e3b-8f0a-07d45a16a13f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:04.199396 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0424e83-dc88-4e3b-8f0a-07d45a16a13f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:04.199938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0424e83-dc88-4e3b-8f0a-07d45a16a13f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:04.201100 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0424e83-dc88-4e3b-8f0a-07d45a16a13f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:04.201682 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0424e83-dc88-4e3b-8f0a-07d45a16a13f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:04.350906 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f0424e83-dc88-4e3b-8f0a-07d45a16a13f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:04.358507 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f0424e83-dc88-4e3b-8f0a-07d45a16a13f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.171944 Jul 26 16:42:04.359012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 446/878] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:04 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:05.380450 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cbca6a20-389e-40f3-a6e1-49be4cc13547 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:05.382025 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cbca6a20-389e-40f3-a6e1-49be4cc13547 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:05.393168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbca6a20-389e-40f3-a6e1-49be4cc13547 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:05.393901 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbca6a20-389e-40f3-a6e1-49be4cc13547 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:05.396229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbca6a20-389e-40f3-a6e1-49be4cc13547 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:05.396895 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbca6a20-389e-40f3-a6e1-49be4cc13547 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:05.588223 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cbca6a20-389e-40f3-a6e1-49be4cc13547 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:05.595823 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cbca6a20-389e-40f3-a6e1-49be4cc13547 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.220615 Jul 26 16:42:05.596395 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 433/879] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:05 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:06.617232 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5f4f045b-cfaf-4cdb-aa60-434567cddf65 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:06.618390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5f4f045b-cfaf-4cdb-aa60-434567cddf65 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:06.621001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:06.626071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f4f045b-cfaf-4cdb-aa60-434567cddf65 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:06.633576 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f4f045b-cfaf-4cdb-aa60-434567cddf65 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:06.633576 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f4f045b-cfaf-4cdb-aa60-434567cddf65 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:06.633576 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5f4f045b-cfaf-4cdb-aa60-434567cddf65 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:06.762002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5f4f045b-cfaf-4cdb-aa60-434567cddf65 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:06.769978 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5f4f045b-cfaf-4cdb-aa60-434567cddf65 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.156657 Jul 26 16:42:06.770565 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 447/880] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:06 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:07.791679 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f8cc69ac-b463-4c95-ac99-82be005d4dca tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:07.800181 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f8cc69ac-b463-4c95-ac99-82be005d4dca tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:07.802214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:07.806144 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=8 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:07.818122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f8cc69ac-b463-4c95-ac99-82be005d4dca tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:07.818122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f8cc69ac-b463-4c95-ac99-82be005d4dca tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:07.818122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f8cc69ac-b463-4c95-ac99-82be005d4dca tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:07.818122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f8cc69ac-b463-4c95-ac99-82be005d4dca tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:08.223891 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f8cc69ac-b463-4c95-ac99-82be005d4dca tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:08.232368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f8cc69ac-b463-4c95-ac99-82be005d4dca tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.445334 Jul 26 16:42:08.233276 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 434/881] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:07 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:09.254497 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-336ab1c1-c585-44bc-9d7d-2f9e0381be00 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:09.255122 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-336ab1c1-c585-44bc-9d7d-2f9e0381be00 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:09.262286 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-336ab1c1-c585-44bc-9d7d-2f9e0381be00 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:09.262737 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-336ab1c1-c585-44bc-9d7d-2f9e0381be00 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:09.263554 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-336ab1c1-c585-44bc-9d7d-2f9e0381be00 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:09.263988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-336ab1c1-c585-44bc-9d7d-2f9e0381be00 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:09.407317 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-336ab1c1-c585-44bc-9d7d-2f9e0381be00 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:09.418741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-336ab1c1-c585-44bc-9d7d-2f9e0381be00 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.168571 Jul 26 16:42:09.420087 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 448/882] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:09 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:09.893524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-d92f0de2-e5f7-42ba-a3dc-106bbb0e19cd req-638c5df5-9149-401e-b5b1-2d8c2b128a61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee309e14-b43f-4f0f-98dc-ce5222fb9140", "name": "network-vif-plugged", "status": "completed", "tag": "4bed39fa-7b38-4cfd-8ad4-4d313219fd2b"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:42:09.907040 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-d92f0de2-e5f7-42ba-a3dc-106bbb0e19cd req-638c5df5-9149-401e-b5b1-2d8c2b128a61 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:09.907475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-d92f0de2-e5f7-42ba-a3dc-106bbb0e19cd req-638c5df5-9149-401e-b5b1-2d8c2b128a61 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:09.922304 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-d92f0de2-e5f7-42ba-a3dc-106bbb0e19cd req-638c5df5-9149-401e-b5b1-2d8c2b128a61 service nova] Creating event network-vif-plugged:4bed39fa-7b38-4cfd-8ad4-4d313219fd2b for instance ee309e14-b43f-4f0f-98dc-ce5222fb9140 on hv-cinder-85104 Jul 26 16:42:09.928283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-d92f0de2-e5f7-42ba-a3dc-106bbb0e19cd req-638c5df5-9149-401e-b5b1-2d8c2b128a61 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038772 Jul 26 16:42:09.929078 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 435/883] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:42:10.195521 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-04536c88-68ae-4da1-b4fb-32caca4e6c84 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Action: 'create', calling method: .version_select at 0x7f4b6c114c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-828638125", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfl0rS25zcTI78Bx4TuKBPnINN89ub31v77uVEAyoibDYL5/T99tujg+0YYNk4V/YcmAAupF7wnYFYB1o3LBcv6JBzQB3RllQ3/h52LBUhBlQlROBJ/AGhc/eHGUKjpSA=="}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:42:10.211049 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-04536c88-68ae-4da1-b4fb-32caca4e6c84 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Getting quotas for project 94684df47fe14e55af2e72ab5d2ddc48. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:42:10.215606 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-04536c88-68ae-4da1-b4fb-32caca4e6c84 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Getting quotas for user ea4ccbb465094f079dcc4ca3bcac59cb and project 94684df47fe14e55af2e72ab5d2ddc48. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:42:10.324996 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3aec2862-8638-4fa4-bd8c-3f7f32f53813 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:10.325854 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3aec2862-8638-4fa4-bd8c-3f7f32f53813 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:10.332691 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3aec2862-8638-4fa4-bd8c-3f7f32f53813 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:10.333137 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3aec2862-8638-4fa4-bd8c-3f7f32f53813 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:10.336817 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3aec2862-8638-4fa4-bd8c-3f7f32f53813 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:10.336817 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3aec2862-8638-4fa4-bd8c-3f7f32f53813 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:10.360065 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3aec2862-8638-4fa4-bd8c-3f7f32f53813 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/ips" status: 200 len: 151 microversion: 2.20 time: 0.039319 Jul 26 16:42:10.360696 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 436/884] 10.222.0.144 () {60 vars in 1294 bytes} [Tue Jul 26 16:42:10 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:42:10.383516 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-04536c88-68ae-4da1-b4fb-32caca4e6c84 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.422191 Jul 26 16:42:10.384486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 449/885] 10.222.0.144 () {60 vars in 1164 bytes} [Tue Jul 26 16:42:09 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:42:10.442298 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d661fcd5-5250-4f0f-938f-a90174e67a64 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:10.442907 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d661fcd5-5250-4f0f-938f-a90174e67a64 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:10.449286 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d661fcd5-5250-4f0f-938f-a90174e67a64 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:10.449738 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d661fcd5-5250-4f0f-938f-a90174e67a64 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:10.450527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d661fcd5-5250-4f0f-938f-a90174e67a64 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:10.450966 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d661fcd5-5250-4f0f-938f-a90174e67a64 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:10.635516 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d661fcd5-5250-4f0f-938f-a90174e67a64 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:10.643901 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d661fcd5-5250-4f0f-938f-a90174e67a64 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.205445 Jul 26 16:42:10.650971 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 437/886] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:10 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:11.666301 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fb849c72-49fc-4f90-859e-cc5645471070 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:11.666914 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fb849c72-49fc-4f90-859e-cc5645471070 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:11.673539 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fb849c72-49fc-4f90-859e-cc5645471070 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:11.673986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fb849c72-49fc-4f90-859e-cc5645471070 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:11.674744 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fb849c72-49fc-4f90-859e-cc5645471070 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:11.675181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fb849c72-49fc-4f90-859e-cc5645471070 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:11.811860 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fb849c72-49fc-4f90-859e-cc5645471070 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:11.819438 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fb849c72-49fc-4f90-859e-cc5645471070 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.157461 Jul 26 16:42:11.820005 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 450/887] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:11 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:12.840183 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5528d035-cbcf-41e3-bdea-0df735635ec9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:12.840885 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5528d035-cbcf-41e3-bdea-0df735635ec9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:12.847574 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5528d035-cbcf-41e3-bdea-0df735635ec9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:12.848033 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5528d035-cbcf-41e3-bdea-0df735635ec9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:12.848938 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5528d035-cbcf-41e3-bdea-0df735635ec9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:12.849257 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5528d035-cbcf-41e3-bdea-0df735635ec9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:12.853743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=59 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:13.000996 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5528d035-cbcf-41e3-bdea-0df735635ec9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:13.023063 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5528d035-cbcf-41e3-bdea-0df735635ec9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1323 microversion: 2.1 time: 0.186633 Jul 26 16:42:13.024197 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 438/888] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:12 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1323 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:13.134815 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-bdc998e8-0331-4b9f-be8d-f507834cbfb3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:13.135312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-bdc998e8-0331-4b9f-be8d-f507834cbfb3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:13.141909 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bdc998e8-0331-4b9f-be8d-f507834cbfb3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:13.142372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bdc998e8-0331-4b9f-be8d-f507834cbfb3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:13.148158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bdc998e8-0331-4b9f-be8d-f507834cbfb3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:13.148158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bdc998e8-0331-4b9f-be8d-f507834cbfb3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:13.167454 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-bdc998e8-0331-4b9f-be8d-f507834cbfb3 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/ips" status: 200 len: 144 microversion: 2.1 time: 0.036392 Jul 26 16:42:13.168041 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 451/889] 10.222.0.144 () {58 vars in 1253 bytes} [Tue Jul 26 16:42:13 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:42:13.756184 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cbf6e28e-f142-499c-a815-9e1198582464 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:42:13.756813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cbf6e28e-f142-499c-a815-9e1198582464 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:13.764116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbf6e28e-f142-499c-a815-9e1198582464 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:13.764605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbf6e28e-f142-499c-a815-9e1198582464 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:13.765390 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbf6e28e-f142-499c-a815-9e1198582464 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:13.765833 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbf6e28e-f142-499c-a815-9e1198582464 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:13.824103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-cbf6e28e-f142-499c-a815-9e1198582464 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lazy-loading 'flavor' on Instance uuid 959309a9-7e80-4fa3-a819-5c64c66861e5 {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:42:14.048488 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3564fcbe-4107-4e2d-82fd-2b6c2e2f63c5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:14.049869 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3564fcbe-4107-4e2d-82fd-2b6c2e2f63c5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:14.059973 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3564fcbe-4107-4e2d-82fd-2b6c2e2f63c5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:14.060597 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3564fcbe-4107-4e2d-82fd-2b6c2e2f63c5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:14.062350 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3564fcbe-4107-4e2d-82fd-2b6c2e2f63c5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:14.062976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3564fcbe-4107-4e2d-82fd-2b6c2e2f63c5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:14.494870 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3564fcbe-4107-4e2d-82fd-2b6c2e2f63c5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:14.502464 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3564fcbe-4107-4e2d-82fd-2b6c2e2f63c5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1512 microversion: 2.1 time: 0.457929 Jul 26 16:42:14.503222 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 452/890] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:14 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1512 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:42:14.695048 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cbf6e28e-f142-499c-a815-9e1198582464 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "POST /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/action" status: 202 len: 0 microversion: 2.20 time: 0.942701 Jul 26 16:42:14.695853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 439/891] 10.222.0.144 () {62 vars in 1324 bytes} [Tue Jul 26 16:42:13 2022] POST /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/action => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:42:14.705388 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1d1a8970-1cae-47f7-aa1a-8cb566c24de8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:14.706422 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1d1a8970-1cae-47f7-aa1a-8cb566c24de8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:14.717125 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d1a8970-1cae-47f7-aa1a-8cb566c24de8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:14.717431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d1a8970-1cae-47f7-aa1a-8cb566c24de8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:14.718207 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d1a8970-1cae-47f7-aa1a-8cb566c24de8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:14.718635 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1d1a8970-1cae-47f7-aa1a-8cb566c24de8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:14.855579 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1d1a8970-1cae-47f7-aa1a-8cb566c24de8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:14.863583 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1d1a8970-1cae-47f7-aa1a-8cb566c24de8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:14.865125 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1d1a8970-1cae-47f7-aa1a-8cb566c24de8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:14.866272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1d1a8970-1cae-47f7-aa1a-8cb566c24de8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.165644 Jul 26 16:42:14.866831 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 453/892] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:14 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:15.689406 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cfd84d0b-e555-4d96-b15c-51c9c637970d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e2be7a3-5e7a-4a9d-8158-bd880b76af68"}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:42:15.689406 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cfd84d0b-e555-4d96-b15c-51c9c637970d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:15.695178 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cfd84d0b-e555-4d96-b15c-51c9c637970d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:15.695720 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cfd84d0b-e555-4d96-b15c-51c9c637970d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:15.697016 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cfd84d0b-e555-4d96-b15c-51c9c637970d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:15.697514 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cfd84d0b-e555-4d96-b15c-51c9c637970d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:15.892258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-437b8d3d-9a1a-4db6-b309-7930749cfbea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:15.892258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-437b8d3d-9a1a-4db6-b309-7930749cfbea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:15.900183 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-437b8d3d-9a1a-4db6-b309-7930749cfbea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:15.900665 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-437b8d3d-9a1a-4db6-b309-7930749cfbea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:15.901535 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-437b8d3d-9a1a-4db6-b309-7930749cfbea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:15.902055 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-437b8d3d-9a1a-4db6-b309-7930749cfbea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:16.036717 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-437b8d3d-9a1a-4db6-b309-7930749cfbea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:16.044988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-437b8d3d-9a1a-4db6-b309-7930749cfbea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:16.046680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-437b8d3d-9a1a-4db6-b309-7930749cfbea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:16.048019 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-437b8d3d-9a1a-4db6-b309-7930749cfbea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.161956 Jul 26 16:42:16.048613 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 454/893] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:15 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:42:16.681630 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cfd84d0b-e555-4d96-b15c-51c9c637970d tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.001173 Jul 26 16:42:16.684077 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 440/894] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:42:15 2022] POST /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments => generated 194 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:42:17.070929 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-36739168-26d0-4664-a3b9-e6a285c2b262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:17.071529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-36739168-26d0-4664-a3b9-e6a285c2b262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:17.078636 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-36739168-26d0-4664-a3b9-e6a285c2b262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:17.079080 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-36739168-26d0-4664-a3b9-e6a285c2b262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:17.079842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-36739168-26d0-4664-a3b9-e6a285c2b262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:17.080269 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-36739168-26d0-4664-a3b9-e6a285c2b262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:17.215793 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-36739168-26d0-4664-a3b9-e6a285c2b262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:17.224626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-36739168-26d0-4664-a3b9-e6a285c2b262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:17.226150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-36739168-26d0-4664-a3b9-e6a285c2b262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:17.227351 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-36739168-26d0-4664-a3b9-e6a285c2b262 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.160314 Jul 26 16:42:17.227901 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 455/895] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:17 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:18.252186 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6002d831-88c5-4fb8-95c3-6695a9c87a83 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:18.252828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6002d831-88c5-4fb8-95c3-6695a9c87a83 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:18.259530 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6002d831-88c5-4fb8-95c3-6695a9c87a83 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:18.259987 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6002d831-88c5-4fb8-95c3-6695a9c87a83 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:18.260781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6002d831-88c5-4fb8-95c3-6695a9c87a83 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:18.261217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6002d831-88c5-4fb8-95c3-6695a9c87a83 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:18.395007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6002d831-88c5-4fb8-95c3-6695a9c87a83 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:18.402885 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6002d831-88c5-4fb8-95c3-6695a9c87a83 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:18.404378 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6002d831-88c5-4fb8-95c3-6695a9c87a83 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:18.405612 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6002d831-88c5-4fb8-95c3-6695a9c87a83 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.158265 Jul 26 16:42:18.406581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 441/896] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:18 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:19.429355 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b7fb9179-855e-4d8d-b6a3-61ef37d4c81e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:19.429970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b7fb9179-855e-4d8d-b6a3-61ef37d4c81e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:19.437010 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b7fb9179-855e-4d8d-b6a3-61ef37d4c81e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:19.437462 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b7fb9179-855e-4d8d-b6a3-61ef37d4c81e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:19.438226 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b7fb9179-855e-4d8d-b6a3-61ef37d4c81e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:19.438660 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b7fb9179-855e-4d8d-b6a3-61ef37d4c81e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:19.569995 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b7fb9179-855e-4d8d-b6a3-61ef37d4c81e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:19.578478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b7fb9179-855e-4d8d-b6a3-61ef37d4c81e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:19.579993 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b7fb9179-855e-4d8d-b6a3-61ef37d4c81e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:19.581179 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b7fb9179-855e-4d8d-b6a3-61ef37d4c81e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.155927 Jul 26 16:42:19.581736 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 456/897] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:19 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:20.604966 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a05eeb89-8315-40f3-8d87-c093b44da24f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:20.605594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a05eeb89-8315-40f3-8d87-c093b44da24f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:20.612194 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a05eeb89-8315-40f3-8d87-c093b44da24f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:20.612673 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a05eeb89-8315-40f3-8d87-c093b44da24f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:20.613431 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a05eeb89-8315-40f3-8d87-c093b44da24f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:20.613863 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a05eeb89-8315-40f3-8d87-c093b44da24f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:20.749117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a05eeb89-8315-40f3-8d87-c093b44da24f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:20.756947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a05eeb89-8315-40f3-8d87-c093b44da24f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:20.758441 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a05eeb89-8315-40f3-8d87-c093b44da24f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:20.759573 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a05eeb89-8315-40f3-8d87-c093b44da24f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.159101 Jul 26 16:42:20.760171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 442/898] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:20 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:21.786182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e39c6acb-82b7-4024-b2ed-925255919495 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:21.786791 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e39c6acb-82b7-4024-b2ed-925255919495 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:21.788657 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=4 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:21.793894 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e39c6acb-82b7-4024-b2ed-925255919495 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:21.794341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e39c6acb-82b7-4024-b2ed-925255919495 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:21.795098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e39c6acb-82b7-4024-b2ed-925255919495 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:21.795529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e39c6acb-82b7-4024-b2ed-925255919495 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:21.936849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e39c6acb-82b7-4024-b2ed-925255919495 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:21.944943 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e39c6acb-82b7-4024-b2ed-925255919495 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:21.946429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e39c6acb-82b7-4024-b2ed-925255919495 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:21.948071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e39c6acb-82b7-4024-b2ed-925255919495 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.165315 Jul 26 16:42:21.948650 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 457/899] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:21 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:42:22.970636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-99ceccf4-3353-48e9-8f0f-94e2275b1da9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:22.971226 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-99ceccf4-3353-48e9-8f0f-94e2275b1da9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:22.978090 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-99ceccf4-3353-48e9-8f0f-94e2275b1da9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:22.978531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-99ceccf4-3353-48e9-8f0f-94e2275b1da9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:22.980037 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-99ceccf4-3353-48e9-8f0f-94e2275b1da9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:22.980594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-99ceccf4-3353-48e9-8f0f-94e2275b1da9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:23.126538 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-99ceccf4-3353-48e9-8f0f-94e2275b1da9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:23.134552 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-99ceccf4-3353-48e9-8f0f-94e2275b1da9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:23.136086 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-99ceccf4-3353-48e9-8f0f-94e2275b1da9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:23.137273 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-99ceccf4-3353-48e9-8f0f-94e2275b1da9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.170532 Jul 26 16:42:23.137834 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 443/900] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:22 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:24.164486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e9954ba0-568d-42d4-9889-5b584a8d0286 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:24.164486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e9954ba0-568d-42d4-9889-5b584a8d0286 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:24.172490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e9954ba0-568d-42d4-9889-5b584a8d0286 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:24.173024 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e9954ba0-568d-42d4-9889-5b584a8d0286 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:24.173865 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e9954ba0-568d-42d4-9889-5b584a8d0286 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:24.174362 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e9954ba0-568d-42d4-9889-5b584a8d0286 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:24.306337 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e9954ba0-568d-42d4-9889-5b584a8d0286 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:24.316760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e9954ba0-568d-42d4-9889-5b584a8d0286 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:24.318465 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e9954ba0-568d-42d4-9889-5b584a8d0286 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:24.320118 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e9954ba0-568d-42d4-9889-5b584a8d0286 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.161467 Jul 26 16:42:24.320885 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 458/901] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:24 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:25.271725 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-434a583f-ff09-4011-ad4f-6b57bba34d5b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:25.274045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-434a583f-ff09-4011-ad4f-6b57bba34d5b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:25.280658 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-434a583f-ff09-4011-ad4f-6b57bba34d5b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:25.281185 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-434a583f-ff09-4011-ad4f-6b57bba34d5b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:25.282208 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-434a583f-ff09-4011-ad4f-6b57bba34d5b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:25.282642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-434a583f-ff09-4011-ad4f-6b57bba34d5b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:25.311282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-434a583f-ff09-4011-ad4f-6b57bba34d5b tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Jul 26 16:42:25.316030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 444/902] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:42:25 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:42:25.322346 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6b0a05ee-dd07-4eaf-9a46-0adadf08e588 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:25.324312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6b0a05ee-dd07-4eaf-9a46-0adadf08e588 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:25.330084 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6b0a05ee-dd07-4eaf-9a46-0adadf08e588 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:25.330535 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6b0a05ee-dd07-4eaf-9a46-0adadf08e588 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:25.331363 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6b0a05ee-dd07-4eaf-9a46-0adadf08e588 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:25.331795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6b0a05ee-dd07-4eaf-9a46-0adadf08e588 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:25.345055 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-38913bcf-291b-409c-9a2a-8617a90cb180 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:25.345055 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-38913bcf-291b-409c-9a2a-8617a90cb180 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:25.352709 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-38913bcf-291b-409c-9a2a-8617a90cb180 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:25.353161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-38913bcf-291b-409c-9a2a-8617a90cb180 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:25.353928 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-38913bcf-291b-409c-9a2a-8617a90cb180 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:25.354363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-38913bcf-291b-409c-9a2a-8617a90cb180 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:25.364525 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6b0a05ee-dd07-4eaf-9a46-0adadf08e588 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments/8e2be7a3-5e7a-4a9d-8158-bd880b76af68" status: 200 len: 194 microversion: 2.1 time: 0.045993 Jul 26 16:42:25.365122 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 459/903] 10.222.0.144 () {58 vars in 1418 bytes} [Tue Jul 26 16:42:25 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments/8e2be7a3-5e7a-4a9d-8158-bd880b76af68 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:42:25.499493 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-38913bcf-291b-409c-9a2a-8617a90cb180 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:25.507456 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-38913bcf-291b-409c-9a2a-8617a90cb180 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:25.508992 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-38913bcf-291b-409c-9a2a-8617a90cb180 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:25.510710 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-38913bcf-291b-409c-9a2a-8617a90cb180 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.170287 Jul 26 16:42:25.511283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 445/904] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:25 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:26.534425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fe68bd22-6f32-405f-981e-c5ad0970c3ec tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:26.534968 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fe68bd22-6f32-405f-981e-c5ad0970c3ec tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:26.541409 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fe68bd22-6f32-405f-981e-c5ad0970c3ec tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:26.552091 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fe68bd22-6f32-405f-981e-c5ad0970c3ec tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:26.552091 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fe68bd22-6f32-405f-981e-c5ad0970c3ec tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:26.552091 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fe68bd22-6f32-405f-981e-c5ad0970c3ec tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:26.674111 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fe68bd22-6f32-405f-981e-c5ad0970c3ec tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:26.677612 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:26.682473 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fe68bd22-6f32-405f-981e-c5ad0970c3ec tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:26.683963 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fe68bd22-6f32-405f-981e-c5ad0970c3ec tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:26.685128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fe68bd22-6f32-405f-981e-c5ad0970c3ec tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.155043 Jul 26 16:42:26.685683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 460/905] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:26 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:27.708507 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-744e4a87-6885-440a-85fe-ec6c3b8e4213 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:27.709061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-744e4a87-6885-440a-85fe-ec6c3b8e4213 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:27.711940 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:27.718598 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-744e4a87-6885-440a-85fe-ec6c3b8e4213 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:27.719185 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-744e4a87-6885-440a-85fe-ec6c3b8e4213 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:27.727103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-744e4a87-6885-440a-85fe-ec6c3b8e4213 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:27.727103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-744e4a87-6885-440a-85fe-ec6c3b8e4213 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:27.853153 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-744e4a87-6885-440a-85fe-ec6c3b8e4213 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:27.862036 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-744e4a87-6885-440a-85fe-ec6c3b8e4213 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:27.863564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-744e4a87-6885-440a-85fe-ec6c3b8e4213 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:27.864798 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-744e4a87-6885-440a-85fe-ec6c3b8e4213 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.160376 Jul 26 16:42:27.865358 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 446/906] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:27 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:28.201417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-99d7bff3-b294-40a7-b0e2-45120b377e23 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23b85ab8-03e4-429d-98aa-6f6c30bede8d"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:42:28.204115 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-99d7bff3-b294-40a7-b0e2-45120b377e23 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:28.211692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-99d7bff3-b294-40a7-b0e2-45120b377e23 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:28.212165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-99d7bff3-b294-40a7-b0e2-45120b377e23 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:28.212982 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-99d7bff3-b294-40a7-b0e2-45120b377e23 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:28.213413 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-99d7bff3-b294-40a7-b0e2-45120b377e23 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:28.889419 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-34f9cbe5-a5ac-4b39-b44b-af5f5b76cbe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:28.890282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-34f9cbe5-a5ac-4b39-b44b-af5f5b76cbe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:28.896855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-34f9cbe5-a5ac-4b39-b44b-af5f5b76cbe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:28.897301 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-34f9cbe5-a5ac-4b39-b44b-af5f5b76cbe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:28.898058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-34f9cbe5-a5ac-4b39-b44b-af5f5b76cbe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:28.898532 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-34f9cbe5-a5ac-4b39-b44b-af5f5b76cbe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:29.038533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-34f9cbe5-a5ac-4b39-b44b-af5f5b76cbe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:29.047048 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-34f9cbe5-a5ac-4b39-b44b-af5f5b76cbe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:29.048632 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-34f9cbe5-a5ac-4b39-b44b-af5f5b76cbe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:29.049933 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-34f9cbe5-a5ac-4b39-b44b-af5f5b76cbe4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1748 microversion: 2.20 time: 0.166244 Jul 26 16:42:29.050501 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 447/907] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:28 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1748 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:42:29.378173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-99d7bff3-b294-40a7-b0e2-45120b377e23 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "POST /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.183409 Jul 26 16:42:29.378782 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 461/908] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:42:28 2022] POST /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments => generated 194 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:42:30.074068 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fdb924b1-2454-4e3d-a1ae-f45c3ee64e02 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:30.074649 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fdb924b1-2454-4e3d-a1ae-f45c3ee64e02 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:30.081173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fdb924b1-2454-4e3d-a1ae-f45c3ee64e02 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:30.081623 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fdb924b1-2454-4e3d-a1ae-f45c3ee64e02 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:30.082386 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fdb924b1-2454-4e3d-a1ae-f45c3ee64e02 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:30.082816 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fdb924b1-2454-4e3d-a1ae-f45c3ee64e02 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:30.212691 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fdb924b1-2454-4e3d-a1ae-f45c3ee64e02 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:30.220778 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fdb924b1-2454-4e3d-a1ae-f45c3ee64e02 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:30.222273 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fdb924b1-2454-4e3d-a1ae-f45c3ee64e02 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:30.223409 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fdb924b1-2454-4e3d-a1ae-f45c3ee64e02 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1748 microversion: 2.20 time: 0.153423 Jul 26 16:42:30.223960 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 448/909] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:30 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:31.247372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-59ca11ba-9d88-4c1d-b06f-c49fa2ca8fa6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:31.248064 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-59ca11ba-9d88-4c1d-b06f-c49fa2ca8fa6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:31.250550 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:31.255642 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59ca11ba-9d88-4c1d-b06f-c49fa2ca8fa6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:31.256021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59ca11ba-9d88-4c1d-b06f-c49fa2ca8fa6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:31.256833 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59ca11ba-9d88-4c1d-b06f-c49fa2ca8fa6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:31.257289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-59ca11ba-9d88-4c1d-b06f-c49fa2ca8fa6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:31.385697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-59ca11ba-9d88-4c1d-b06f-c49fa2ca8fa6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:31.393791 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-59ca11ba-9d88-4c1d-b06f-c49fa2ca8fa6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:31.395495 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-59ca11ba-9d88-4c1d-b06f-c49fa2ca8fa6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:31.396987 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-59ca11ba-9d88-4c1d-b06f-c49fa2ca8fa6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1748 microversion: 2.20 time: 0.154241 Jul 26 16:42:31.400436 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 462/910] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:31 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:32.420561 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7f846680-caab-47f1-a69a-65e27336cc84 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:32.421166 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7f846680-caab-47f1-a69a-65e27336cc84 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:32.427681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f846680-caab-47f1-a69a-65e27336cc84 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:32.428128 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f846680-caab-47f1-a69a-65e27336cc84 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:32.428924 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f846680-caab-47f1-a69a-65e27336cc84 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:32.429359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7f846680-caab-47f1-a69a-65e27336cc84 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:32.561647 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7f846680-caab-47f1-a69a-65e27336cc84 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:32.569857 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7f846680-caab-47f1-a69a-65e27336cc84 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:32.571413 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7f846680-caab-47f1-a69a-65e27336cc84 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:32.572611 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7f846680-caab-47f1-a69a-65e27336cc84 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1748 microversion: 2.20 time: 0.155948 Jul 26 16:42:32.573229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 449/911] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:32 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:33.555609 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-15b44825-9314-4a92-a831-ae118aad3795 req-80b03625-de70-41eb-8b0b-00896cb866dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959309a9-7e80-4fa3-a819-5c64c66861e5", "name": "network-vif-plugged", "status": "completed", "tag": "5e531cc9-c347-49e5-b738-d36aac7e7939"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:42:33.565514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-15b44825-9314-4a92-a831-ae118aad3795 req-80b03625-de70-41eb-8b0b-00896cb866dc service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:33.568262 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-15b44825-9314-4a92-a831-ae118aad3795 req-80b03625-de70-41eb-8b0b-00896cb866dc service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:33.576708 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-15b44825-9314-4a92-a831-ae118aad3795 req-80b03625-de70-41eb-8b0b-00896cb866dc service nova] Creating event network-vif-plugged:5e531cc9-c347-49e5-b738-d36aac7e7939 for instance 959309a9-7e80-4fa3-a819-5c64c66861e5 on hv-cinder-85104 Jul 26 16:42:33.581786 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-15b44825-9314-4a92-a831-ae118aad3795 req-80b03625-de70-41eb-8b0b-00896cb866dc service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029754 Jul 26 16:42:33.582382 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 463/912] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:42:33.597074 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5eec28f5-bbac-4b73-b405-b38bc7b9fcc5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:33.597681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5eec28f5-bbac-4b73-b405-b38bc7b9fcc5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:33.604190 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5eec28f5-bbac-4b73-b405-b38bc7b9fcc5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:33.604677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5eec28f5-bbac-4b73-b405-b38bc7b9fcc5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:33.605482 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5eec28f5-bbac-4b73-b405-b38bc7b9fcc5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:33.605922 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5eec28f5-bbac-4b73-b405-b38bc7b9fcc5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:33.986354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5eec28f5-bbac-4b73-b405-b38bc7b9fcc5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:33.994671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5eec28f5-bbac-4b73-b405-b38bc7b9fcc5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:33.996175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-5eec28f5-bbac-4b73-b405-b38bc7b9fcc5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:33.997349 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5eec28f5-bbac-4b73-b405-b38bc7b9fcc5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1748 microversion: 2.20 time: 0.404687 Jul 26 16:42:33.997902 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 450/913] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:33 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1748 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:35.023111 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-df4c0bda-2f42-4b56-a936-4decac592644 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:35.023840 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-df4c0bda-2f42-4b56-a936-4decac592644 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:35.032225 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-df4c0bda-2f42-4b56-a936-4decac592644 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:35.032710 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-df4c0bda-2f42-4b56-a936-4decac592644 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:35.033472 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-df4c0bda-2f42-4b56-a936-4decac592644 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:35.033905 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-df4c0bda-2f42-4b56-a936-4decac592644 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:35.214089 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-df4c0bda-2f42-4b56-a936-4decac592644 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:35.222537 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-df4c0bda-2f42-4b56-a936-4decac592644 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:35.224039 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-df4c0bda-2f42-4b56-a936-4decac592644 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:35.225204 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-df4c0bda-2f42-4b56-a936-4decac592644 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1748 microversion: 2.20 time: 0.206850 Jul 26 16:42:35.225759 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 464/914] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:35 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1748 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:36.248694 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8a3840a1-cbc4-4ca6-bea8-ad44313b9bc6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:36.249286 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8a3840a1-cbc4-4ca6-bea8-ad44313b9bc6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:36.256443 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a3840a1-cbc4-4ca6-bea8-ad44313b9bc6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:36.256946 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a3840a1-cbc4-4ca6-bea8-ad44313b9bc6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:36.257824 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a3840a1-cbc4-4ca6-bea8-ad44313b9bc6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:36.258269 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a3840a1-cbc4-4ca6-bea8-ad44313b9bc6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:36.272623 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:36.390031 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8a3840a1-cbc4-4ca6-bea8-ad44313b9bc6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:36.397802 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8a3840a1-cbc4-4ca6-bea8-ad44313b9bc6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:36.399301 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8a3840a1-cbc4-4ca6-bea8-ad44313b9bc6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:36.400514 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8a3840a1-cbc4-4ca6-bea8-ad44313b9bc6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1748 microversion: 2.20 time: 0.155895 Jul 26 16:42:36.401053 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 451/915] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:36 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:37.424595 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5a1997d9-df5f-4d35-8d84-9e80cb3419c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:37.425141 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5a1997d9-df5f-4d35-8d84-9e80cb3419c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:37.431590 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a1997d9-df5f-4d35-8d84-9e80cb3419c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:37.432035 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a1997d9-df5f-4d35-8d84-9e80cb3419c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:37.432849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a1997d9-df5f-4d35-8d84-9e80cb3419c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:37.433284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a1997d9-df5f-4d35-8d84-9e80cb3419c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:37.565509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5a1997d9-df5f-4d35-8d84-9e80cb3419c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:37.573280 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5a1997d9-df5f-4d35-8d84-9e80cb3419c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:37.574781 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5a1997d9-df5f-4d35-8d84-9e80cb3419c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:37.575923 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5a1997d9-df5f-4d35-8d84-9e80cb3419c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.155886 Jul 26 16:42:37.576497 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 465/916] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:37 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:42:38.607765 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-10de6a78-e7b9-4322-ac59-de3696eef56b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:38.608436 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-10de6a78-e7b9-4322-ac59-de3696eef56b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:38.618364 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-10de6a78-e7b9-4322-ac59-de3696eef56b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:38.618818 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-10de6a78-e7b9-4322-ac59-de3696eef56b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:38.619595 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-10de6a78-e7b9-4322-ac59-de3696eef56b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:38.620038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-10de6a78-e7b9-4322-ac59-de3696eef56b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:38.754520 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-10de6a78-e7b9-4322-ac59-de3696eef56b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:38.765323 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-10de6a78-e7b9-4322-ac59-de3696eef56b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:38.766809 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-10de6a78-e7b9-4322-ac59-de3696eef56b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:38.768003 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-10de6a78-e7b9-4322-ac59-de3696eef56b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.164917 Jul 26 16:42:38.768570 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 452/917] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:38 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:39.053164 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-73a64379-2b25-445a-b410-1a173b1971fc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:39.057444 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-73a64379-2b25-445a-b410-1a173b1971fc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:39.069641 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-73a64379-2b25-445a-b410-1a173b1971fc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:39.070450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-73a64379-2b25-445a-b410-1a173b1971fc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:39.071525 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-73a64379-2b25-445a-b410-1a173b1971fc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:39.072177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-73a64379-2b25-445a-b410-1a173b1971fc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:39.112650 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-73a64379-2b25-445a-b410-1a173b1971fc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.065847 Jul 26 16:42:39.113881 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 466/918] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:42:39 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments => generated 371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:42:39.267102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7e7c5a19-f50b-44e4-8bdb-9010c8ca457f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:39.267675 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7e7c5a19-f50b-44e4-8bdb-9010c8ca457f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:39.275015 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e7c5a19-f50b-44e4-8bdb-9010c8ca457f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:39.276006 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e7c5a19-f50b-44e4-8bdb-9010c8ca457f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:39.277698 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e7c5a19-f50b-44e4-8bdb-9010c8ca457f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:39.278499 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e7c5a19-f50b-44e4-8bdb-9010c8ca457f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:39.339247 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7e7c5a19-f50b-44e4-8bdb-9010c8ca457f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments/8e2be7a3-5e7a-4a9d-8158-bd880b76af68" status: 200 len: 194 microversion: 2.1 time: 0.077717 Jul 26 16:42:39.340143 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 453/919] 10.222.0.144 () {58 vars in 1418 bytes} [Tue Jul 26 16:42:39 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments/8e2be7a3-5e7a-4a9d-8158-bd880b76af68 => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:42:39.352095 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5d0431bd-cfe2-478e-9a78-ce8f1d81696f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:39.352861 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5d0431bd-cfe2-478e-9a78-ce8f1d81696f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:39.359437 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d0431bd-cfe2-478e-9a78-ce8f1d81696f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:39.359880 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d0431bd-cfe2-478e-9a78-ce8f1d81696f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:39.364496 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d0431bd-cfe2-478e-9a78-ce8f1d81696f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:39.364496 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d0431bd-cfe2-478e-9a78-ce8f1d81696f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:39.453813 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-5d0431bd-cfe2-478e-9a78-ce8f1d81696f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lazy-loading 'services' on Instance uuid b9b55f3f-7f6d-4179-8574-11cc47c32566 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:42:39.734633 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5d0431bd-cfe2-478e-9a78-ce8f1d81696f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "DELETE /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments/8e2be7a3-5e7a-4a9d-8158-bd880b76af68" status: 202 len: 0 microversion: 2.1 time: 0.386836 Jul 26 16:42:39.738962 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 467/920] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:42:39 2022] DELETE /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments/8e2be7a3-5e7a-4a9d-8158-bd880b76af68 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 16:42:39.792768 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f1d5c71c-1372-4bb6-ac2e-215cbb1ffe15 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:39.793376 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f1d5c71c-1372-4bb6-ac2e-215cbb1ffe15 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:39.800746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f1d5c71c-1372-4bb6-ac2e-215cbb1ffe15 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:39.801201 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f1d5c71c-1372-4bb6-ac2e-215cbb1ffe15 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:39.801971 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f1d5c71c-1372-4bb6-ac2e-215cbb1ffe15 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:39.802407 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f1d5c71c-1372-4bb6-ac2e-215cbb1ffe15 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:39.950466 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f1d5c71c-1372-4bb6-ac2e-215cbb1ffe15 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:39.959253 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f1d5c71c-1372-4bb6-ac2e-215cbb1ffe15 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:39.960883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f1d5c71c-1372-4bb6-ac2e-215cbb1ffe15 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:39.962107 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f1d5c71c-1372-4bb6-ac2e-215cbb1ffe15 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.173326 Jul 26 16:42:39.962826 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 454/921] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:39 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:42:40.986001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-791aef0a-8f17-4df4-8a1a-b89688dbdd03 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:40.987345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-791aef0a-8f17-4df4-8a1a-b89688dbdd03 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:40.993587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-791aef0a-8f17-4df4-8a1a-b89688dbdd03 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:40.994030 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-791aef0a-8f17-4df4-8a1a-b89688dbdd03 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:40.994784 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-791aef0a-8f17-4df4-8a1a-b89688dbdd03 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:40.995214 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-791aef0a-8f17-4df4-8a1a-b89688dbdd03 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:41.226794 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-791aef0a-8f17-4df4-8a1a-b89688dbdd03 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:41.237183 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-791aef0a-8f17-4df4-8a1a-b89688dbdd03 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:41.239082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-791aef0a-8f17-4df4-8a1a-b89688dbdd03 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:41.240273 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-791aef0a-8f17-4df4-8a1a-b89688dbdd03 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.259050 Jul 26 16:42:41.252596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 468/922] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:40 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:41.928074 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5726604f-d904-4246-bd6d-9be35f16a90a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:41.928670 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5726604f-d904-4246-bd6d-9be35f16a90a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:41.935274 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5726604f-d904-4246-bd6d-9be35f16a90a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:41.935726 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5726604f-d904-4246-bd6d-9be35f16a90a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:41.936580 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5726604f-d904-4246-bd6d-9be35f16a90a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:41.937667 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5726604f-d904-4246-bd6d-9be35f16a90a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:41.967223 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5726604f-d904-4246-bd6d-9be35f16a90a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments/23b85ab8-03e4-429d-98aa-6f6c30bede8d" status: 200 len: 194 microversion: 2.1 time: 0.043748 Jul 26 16:42:41.967795 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 455/923] 10.222.0.144 () {58 vars in 1418 bytes} [Tue Jul 26 16:42:41 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments/23b85ab8-03e4-429d-98aa-6f6c30bede8d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:42:41.978197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7ec2befd-100f-4d05-adc4-7d8d85cee061 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:41.978980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7ec2befd-100f-4d05-adc4-7d8d85cee061 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:41.986374 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ec2befd-100f-4d05-adc4-7d8d85cee061 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:41.986971 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ec2befd-100f-4d05-adc4-7d8d85cee061 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:41.987798 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ec2befd-100f-4d05-adc4-7d8d85cee061 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:41.988360 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ec2befd-100f-4d05-adc4-7d8d85cee061 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:42.087997 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-7ec2befd-100f-4d05-adc4-7d8d85cee061 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lazy-loading 'services' on Instance uuid b9b55f3f-7f6d-4179-8574-11cc47c32566 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:42:42.266027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4ef909f3-261a-49a0-8e3e-bb0622d45a46 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:42.276844 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4ef909f3-261a-49a0-8e3e-bb0622d45a46 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:42.279204 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4ef909f3-261a-49a0-8e3e-bb0622d45a46 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:42.280179 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4ef909f3-261a-49a0-8e3e-bb0622d45a46 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:42.281680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4ef909f3-261a-49a0-8e3e-bb0622d45a46 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:42.282688 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4ef909f3-261a-49a0-8e3e-bb0622d45a46 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:42.419234 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7ec2befd-100f-4d05-adc4-7d8d85cee061 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "DELETE /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments/23b85ab8-03e4-429d-98aa-6f6c30bede8d" status: 202 len: 0 microversion: 2.1 time: 0.444843 Jul 26 16:42:42.419852 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 469/924] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:42:41 2022] DELETE /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments/23b85ab8-03e4-429d-98aa-6f6c30bede8d => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:42:42.449877 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4ef909f3-261a-49a0-8e3e-bb0622d45a46 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:42.460669 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4ef909f3-261a-49a0-8e3e-bb0622d45a46 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:42.462742 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4ef909f3-261a-49a0-8e3e-bb0622d45a46 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:42.464495 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4ef909f3-261a-49a0-8e3e-bb0622d45a46 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.203290 Jul 26 16:42:42.480843 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 456/925] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:42 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:43.492020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c8105321-8458-45ce-83da-7b12f26fe5d5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:43.493361 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c8105321-8458-45ce-83da-7b12f26fe5d5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:43.502213 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c8105321-8458-45ce-83da-7b12f26fe5d5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:43.502870 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c8105321-8458-45ce-83da-7b12f26fe5d5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:43.504123 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c8105321-8458-45ce-83da-7b12f26fe5d5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:43.504602 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c8105321-8458-45ce-83da-7b12f26fe5d5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:43.644826 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c8105321-8458-45ce-83da-7b12f26fe5d5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:43.652781 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c8105321-8458-45ce-83da-7b12f26fe5d5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:43.654285 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c8105321-8458-45ce-83da-7b12f26fe5d5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:43.655465 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c8105321-8458-45ce-83da-7b12f26fe5d5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.168394 Jul 26 16:42:43.656015 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 470/926] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:43 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:44.679183 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2555d7da-50ad-431b-835d-f0a74c7bdca4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:44.680351 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2555d7da-50ad-431b-835d-f0a74c7bdca4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:44.686535 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c9487072-ed44-4b04-aa6a-443b24347a0f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:44.687566 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2555d7da-50ad-431b-835d-f0a74c7bdca4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:44.689378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c9487072-ed44-4b04-aa6a-443b24347a0f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:44.691085 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2555d7da-50ad-431b-835d-f0a74c7bdca4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:44.693381 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2555d7da-50ad-431b-835d-f0a74c7bdca4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:44.693825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2555d7da-50ad-431b-835d-f0a74c7bdca4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:44.696369 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9487072-ed44-4b04-aa6a-443b24347a0f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:44.696845 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9487072-ed44-4b04-aa6a-443b24347a0f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:44.697783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9487072-ed44-4b04-aa6a-443b24347a0f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:44.698375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c9487072-ed44-4b04-aa6a-443b24347a0f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:44.727598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c9487072-ed44-4b04-aa6a-443b24347a0f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044915 Jul 26 16:42:44.728430 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 471/927] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:42:44 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 26 16:42:44.849980 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2555d7da-50ad-431b-835d-f0a74c7bdca4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:44.852566 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2efc5015-6f78-45c5-8caa-842f16a28a4a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:44.854795 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2efc5015-6f78-45c5-8caa-842f16a28a4a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:44.858757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2555d7da-50ad-431b-835d-f0a74c7bdca4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:44.860832 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2555d7da-50ad-431b-835d-f0a74c7bdca4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:44.862404 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2efc5015-6f78-45c5-8caa-842f16a28a4a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:44.863106 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2efc5015-6f78-45c5-8caa-842f16a28a4a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:44.864083 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2efc5015-6f78-45c5-8caa-842f16a28a4a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:44.864720 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2efc5015-6f78-45c5-8caa-842f16a28a4a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:44.869340 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2555d7da-50ad-431b-835d-f0a74c7bdca4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.194146 Jul 26 16:42:44.870218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 457/928] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:44 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:44.896536 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2efc5015-6f78-45c5-8caa-842f16a28a4a tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048074 Jul 26 16:42:44.897681 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 472/929] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:42:44 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 16:42:44.961787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d345429f-19a5-418e-9a51-c86a303cdad2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:44.962280 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d345429f-19a5-418e-9a51-c86a303cdad2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:44.968224 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d345429f-19a5-418e-9a51-c86a303cdad2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:44.968730 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d345429f-19a5-418e-9a51-c86a303cdad2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:44.969484 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d345429f-19a5-418e-9a51-c86a303cdad2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:44.969911 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d345429f-19a5-418e-9a51-c86a303cdad2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:44.994424 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d345429f-19a5-418e-9a51-c86a303cdad2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:42:45.377465 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d345429f-19a5-418e-9a51-c86a303cdad2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "DELETE /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 204 len: 0 microversion: 2.1 time: 0.419411 Jul 26 16:42:45.380377 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 458/930] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:42:44 2022] DELETE /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:42:45.392917 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0f7b990c-4a53-4414-be6c-c07fc688bb63 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:45.393558 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0f7b990c-4a53-4414-be6c-c07fc688bb63 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:45.403328 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0f7b990c-4a53-4414-be6c-c07fc688bb63 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:45.403778 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0f7b990c-4a53-4414-be6c-c07fc688bb63 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:45.404786 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0f7b990c-4a53-4414-be6c-c07fc688bb63 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:45.405220 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0f7b990c-4a53-4414-be6c-c07fc688bb63 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:45.568545 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0f7b990c-4a53-4414-be6c-c07fc688bb63 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:45.578471 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0f7b990c-4a53-4414-be6c-c07fc688bb63 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1675 microversion: 2.1 time: 0.189785 Jul 26 16:42:45.578958 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 473/931] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:45 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1675 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:45.895834 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-94c3cb91-48ca-4e10-8612-f6033681dbe3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:45.896642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-94c3cb91-48ca-4e10-8612-f6033681dbe3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:45.903509 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94c3cb91-48ca-4e10-8612-f6033681dbe3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:45.904371 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94c3cb91-48ca-4e10-8612-f6033681dbe3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:45.905369 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94c3cb91-48ca-4e10-8612-f6033681dbe3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:45.905822 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94c3cb91-48ca-4e10-8612-f6033681dbe3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:46.039583 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-94c3cb91-48ca-4e10-8612-f6033681dbe3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:46.048740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-94c3cb91-48ca-4e10-8612-f6033681dbe3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:46.050256 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-94c3cb91-48ca-4e10-8612-f6033681dbe3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:46.051413 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-94c3cb91-48ca-4e10-8612-f6033681dbe3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.160928 Jul 26 16:42:46.052169 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 459/932] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:45 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:46.601189 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fca1f0cd-d7d8-463a-9793-cdb12b18d16c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:46.602295 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fca1f0cd-d7d8-463a-9793-cdb12b18d16c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:46.610098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fca1f0cd-d7d8-463a-9793-cdb12b18d16c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:46.610673 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fca1f0cd-d7d8-463a-9793-cdb12b18d16c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:46.611698 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fca1f0cd-d7d8-463a-9793-cdb12b18d16c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:46.612371 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fca1f0cd-d7d8-463a-9793-cdb12b18d16c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:46.757389 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fca1f0cd-d7d8-463a-9793-cdb12b18d16c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:46.766112 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fca1f0cd-d7d8-463a-9793-cdb12b18d16c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1675 microversion: 2.1 time: 0.170341 Jul 26 16:42:46.766677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 474/933] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:46 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:47.074799 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-10559fdc-6b3b-4cab-af1e-046847a63ef4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:47.075530 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-10559fdc-6b3b-4cab-af1e-046847a63ef4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:47.082686 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-10559fdc-6b3b-4cab-af1e-046847a63ef4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:47.083136 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-10559fdc-6b3b-4cab-af1e-046847a63ef4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:47.083902 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-10559fdc-6b3b-4cab-af1e-046847a63ef4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:47.084366 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-10559fdc-6b3b-4cab-af1e-046847a63ef4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:47.216948 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-10559fdc-6b3b-4cab-af1e-046847a63ef4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:47.225770 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-10559fdc-6b3b-4cab-af1e-046847a63ef4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:47.227268 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-10559fdc-6b3b-4cab-af1e-046847a63ef4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:47.228664 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-10559fdc-6b3b-4cab-af1e-046847a63ef4 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.157748 Jul 26 16:42:47.229218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 460/934] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:47 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:47.793339 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-745387ac-5cd5-4a91-b9e4-d1de6e1918b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:47.793890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-745387ac-5cd5-4a91-b9e4-d1de6e1918b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:47.801080 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-745387ac-5cd5-4a91-b9e4-d1de6e1918b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:47.801777 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-745387ac-5cd5-4a91-b9e4-d1de6e1918b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:47.802564 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-745387ac-5cd5-4a91-b9e4-d1de6e1918b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:47.803122 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-745387ac-5cd5-4a91-b9e4-d1de6e1918b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:47.825268 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:47.946591 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-745387ac-5cd5-4a91-b9e4-d1de6e1918b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:47.954341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-745387ac-5cd5-4a91-b9e4-d1de6e1918b1 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1675 microversion: 2.1 time: 0.165036 Jul 26 16:42:47.961094 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 475/935] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:47 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:48.251412 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fe322f08-a350-47e3-9c19-cd6c4844349a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:48.252048 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fe322f08-a350-47e3-9c19-cd6c4844349a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:48.258688 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe322f08-a350-47e3-9c19-cd6c4844349a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:48.259176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe322f08-a350-47e3-9c19-cd6c4844349a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:48.259981 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe322f08-a350-47e3-9c19-cd6c4844349a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:48.260437 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe322f08-a350-47e3-9c19-cd6c4844349a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:48.401107 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fe322f08-a350-47e3-9c19-cd6c4844349a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:48.410939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fe322f08-a350-47e3-9c19-cd6c4844349a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:48.412470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fe322f08-a350-47e3-9c19-cd6c4844349a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:48.413629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fe322f08-a350-47e3-9c19-cd6c4844349a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.166234 Jul 26 16:42:48.414184 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 461/936] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:48 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:48.975187 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ec2d5b38-3768-439b-aa46-3b19fafc67bc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:48.975830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ec2d5b38-3768-439b-aa46-3b19fafc67bc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:48.982499 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec2d5b38-3768-439b-aa46-3b19fafc67bc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:48.985938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec2d5b38-3768-439b-aa46-3b19fafc67bc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:48.985938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec2d5b38-3768-439b-aa46-3b19fafc67bc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:48.985938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec2d5b38-3768-439b-aa46-3b19fafc67bc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:49.118515 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ec2d5b38-3768-439b-aa46-3b19fafc67bc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:49.126469 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ec2d5b38-3768-439b-aa46-3b19fafc67bc tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1675 microversion: 2.1 time: 0.155215 Jul 26 16:42:49.127028 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 476/937] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:48 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:49.436522 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7277d197-db38-4936-9c5f-b956397511a0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:49.437141 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7277d197-db38-4936-9c5f-b956397511a0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:49.444039 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7277d197-db38-4936-9c5f-b956397511a0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:49.444523 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7277d197-db38-4936-9c5f-b956397511a0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:49.445393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7277d197-db38-4936-9c5f-b956397511a0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:49.445717 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7277d197-db38-4936-9c5f-b956397511a0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:49.652650 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7277d197-db38-4936-9c5f-b956397511a0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:49.662911 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7277d197-db38-4936-9c5f-b956397511a0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:49.669159 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7277d197-db38-4936-9c5f-b956397511a0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:49.669372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-ffac0ff9-f335-45a3-b935-db3d7dc2a8f4 req-c2514af4-655d-4f20-b708-3b37121eaac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b55f3f-7f6d-4179-8574-11cc47c32566", "name": "network-vif-deleted", "tag": "1c0fda89-08d0-4795-a5e6-64bfd611749d"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:42:49.670438 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7277d197-db38-4936-9c5f-b956397511a0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.237716 Jul 26 16:42:49.671078 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 462/938] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:49 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:49.681199 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-ffac0ff9-f335-45a3-b935-db3d7dc2a8f4 req-c2514af4-655d-4f20-b708-3b37121eaac1 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:49.681663 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-ffac0ff9-f335-45a3-b935-db3d7dc2a8f4 req-c2514af4-655d-4f20-b708-3b37121eaac1 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:49.695249 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-ffac0ff9-f335-45a3-b935-db3d7dc2a8f4 req-c2514af4-655d-4f20-b708-3b37121eaac1 service nova] Creating event network-vif-deleted:1c0fda89-08d0-4795-a5e6-64bfd611749d for instance b9b55f3f-7f6d-4179-8574-11cc47c32566 on hv-cinder-85104 Jul 26 16:42:49.701722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-ffac0ff9-f335-45a3-b935-db3d7dc2a8f4 req-c2514af4-655d-4f20-b708-3b37121eaac1 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042273 Jul 26 16:42:49.703186 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 477/939] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:42:50.151757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:50.152572 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:50.159787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:50.160343 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:50.161218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:50.161708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:50.200221 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:50.201053 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:50.201613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lazy-loading 'fault' on Instance uuid b9b55f3f-7f6d-4179-8574-11cc47c32566 {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:42:50.254464 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b9d76409f834b478981c0bbc0c3d4b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4088561009754a839604e3798787d8b9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:50.262977 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-269d4667-8f2a-4bbe-bb4b-d27b3e7e2bb2 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 200 len: 1331 microversion: 2.1 time: 0.115633 Jul 26 16:42:50.263556 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 463/940] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:50 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:50.789533 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d229fe07-c982-4add-9416-f3a0730e9a82 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:50.789533 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d229fe07-c982-4add-9416-f3a0730e9a82 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:50.789533 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d229fe07-c982-4add-9416-f3a0730e9a82 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:50.789533 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d229fe07-c982-4add-9416-f3a0730e9a82 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:50.792454 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d229fe07-c982-4add-9416-f3a0730e9a82 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:50.792454 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d229fe07-c982-4add-9416-f3a0730e9a82 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:50.865871 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d229fe07-c982-4add-9416-f3a0730e9a82 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:50.874637 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d229fe07-c982-4add-9416-f3a0730e9a82 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:50.877092 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d229fe07-c982-4add-9416-f3a0730e9a82 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:50.878251 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d229fe07-c982-4add-9416-f3a0730e9a82 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.187510 Jul 26 16:42:50.879002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 478/941] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:50 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:42:51.286072 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f705d42a-3384-45d9-98ec-c6c9e1bfebfe tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:51.286682 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f705d42a-3384-45d9-98ec-c6c9e1bfebfe tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:51.292905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f705d42a-3384-45d9-98ec-c6c9e1bfebfe tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:51.293360 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f705d42a-3384-45d9-98ec-c6c9e1bfebfe tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:51.294125 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f705d42a-3384-45d9-98ec-c6c9e1bfebfe tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:51.294568 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f705d42a-3384-45d9-98ec-c6c9e1bfebfe tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:51.308585 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-f705d42a-3384-45d9-98ec-c6c9e1bfebfe tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] HTTP exception thrown: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f705d42a-3384-45d9-98ec-c6c9e1bfebfe tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Request method failure captured: Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 HTTP/1.1 Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcv7-GmZsMqMa81asrWjNYj6jdoX11buhSIm9RcdQ2qbZIRmMCqA0pySeJmN_qiSq7OFWU2YFF_5MAPPnleNIfLISNZ-HPfnJv-puElKaV-C2FD4oydCp3QeaDLUc2O4BRAkA6mJZuwdW5LEm4OLNNoUktqP-zeYvzl2cWuGeMLee0 Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:42:51.310132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/4088561009754a839604e3798787d8b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_4088561009754a839604e3798787d8b9", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 1b9d76409f834b478981c0bbc0c3d4b6 Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:51.311896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': 'b9b55f3f-7f6d-4179-8574-11cc47c32566'} Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:42:51.312737 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:51.315639 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:51.317715 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f705d42a-3384-45d9-98ec-c6c9e1bfebfe tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Returning 404 to user: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:42:51.317715 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f705d42a-3384-45d9-98ec-c6c9e1bfebfe tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 404 len: 111 microversion: 2.1 time: 0.030270 Jul 26 16:42:51.317715 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 464/942] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:51 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:42:51.320372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-66053a5a-a4bc-4bfc-afee-4039b769bffb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '.version_select at 0x7f4b6c07e5e0>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:51.380961 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-66053a5a-a4bc-4bfc-afee-4039b769bffb tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408676385" status: 202 len: 0 microversion: 2.1 time: 0.064286 Jul 26 16:42:51.382557 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 479/943] 10.222.0.144 () {58 vars in 1226 bytes} [Tue Jul 26 16:42:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1408676385 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 26 16:42:51.902251 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f1400ebb-3dbc-4bb0-8eaa-c6012ea03293 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:51.902865 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f1400ebb-3dbc-4bb0-8eaa-c6012ea03293 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:51.912636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f1400ebb-3dbc-4bb0-8eaa-c6012ea03293 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:51.913071 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f1400ebb-3dbc-4bb0-8eaa-c6012ea03293 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:51.913843 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f1400ebb-3dbc-4bb0-8eaa-c6012ea03293 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:51.914283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f1400ebb-3dbc-4bb0-8eaa-c6012ea03293 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:52.107288 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f1400ebb-3dbc-4bb0-8eaa-c6012ea03293 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:52.117160 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f1400ebb-3dbc-4bb0-8eaa-c6012ea03293 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:52.118672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f1400ebb-3dbc-4bb0-8eaa-c6012ea03293 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:52.119981 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f1400ebb-3dbc-4bb0-8eaa-c6012ea03293 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.222219 Jul 26 16:42:52.120548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 465/944] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:51 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:53.143912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-166e0efd-8c36-4f8b-b2cc-3b1403f19a09 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:53.144686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-166e0efd-8c36-4f8b-b2cc-3b1403f19a09 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:53.152476 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-166e0efd-8c36-4f8b-b2cc-3b1403f19a09 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:53.153142 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-166e0efd-8c36-4f8b-b2cc-3b1403f19a09 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:53.154030 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-166e0efd-8c36-4f8b-b2cc-3b1403f19a09 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:53.154885 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-166e0efd-8c36-4f8b-b2cc-3b1403f19a09 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:53.293896 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-166e0efd-8c36-4f8b-b2cc-3b1403f19a09 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:53.301954 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-166e0efd-8c36-4f8b-b2cc-3b1403f19a09 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:53.303536 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-166e0efd-8c36-4f8b-b2cc-3b1403f19a09 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:53.304726 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-166e0efd-8c36-4f8b-b2cc-3b1403f19a09 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.165315 Jul 26 16:42:53.305288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 480/945] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:53 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:54.329058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-286ee4bc-8e8c-4f17-86fc-f3f50bbc44e8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:54.329696 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-286ee4bc-8e8c-4f17-86fc-f3f50bbc44e8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:54.337144 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-286ee4bc-8e8c-4f17-86fc-f3f50bbc44e8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:54.337590 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-286ee4bc-8e8c-4f17-86fc-f3f50bbc44e8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:54.338362 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-286ee4bc-8e8c-4f17-86fc-f3f50bbc44e8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:54.338795 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-286ee4bc-8e8c-4f17-86fc-f3f50bbc44e8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:54.475263 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-286ee4bc-8e8c-4f17-86fc-f3f50bbc44e8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:54.477754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:54.484920 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-286ee4bc-8e8c-4f17-86fc-f3f50bbc44e8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:54.486439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-286ee4bc-8e8c-4f17-86fc-f3f50bbc44e8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:54.487596 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-286ee4bc-8e8c-4f17-86fc-f3f50bbc44e8 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.162633 Jul 26 16:42:54.488770 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 466/946] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:54 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:54.810664 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d3d28252-5337-4189-a225-3fda5b18c83c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:54.811485 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d3d28252-5337-4189-a225-3fda5b18c83c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:54.818657 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d3d28252-5337-4189-a225-3fda5b18c83c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:54.819425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d3d28252-5337-4189-a225-3fda5b18c83c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:54.820375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d3d28252-5337-4189-a225-3fda5b18c83c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:54.820907 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d3d28252-5337-4189-a225-3fda5b18c83c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:54.838320 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-d3d28252-5337-4189-a225-3fda5b18c83c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] HTTP exception thrown: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d3d28252-5337-4189-a225-3fda5b18c83c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Request method failure captured: Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: DELETE /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 HTTP/1.1 Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcv7-GmZsMqMa81asrWjNYj6jdoX11buhSIm9RcdQ2qbZIRmMCqA0pySeJmN_qiSq7OFWU2YFF_5MAPPnleNIfLISNZ-HPfnJv-puElKaV-C2FD4oydCp3QeaDLUc2O4BRAkA6mJZuwdW5LEm4OLNNoUktqP-zeYvzl2cWuGeMLee0 Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:42:54.840368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/4088561009754a839604e3798787d8b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_4088561009754a839604e3798787d8b9", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 1b9d76409f834b478981c0bbc0c3d4b6 Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:54.841878 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': 'b9b55f3f-7f6d-4179-8574-11cc47c32566'} Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:42:54.842651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:54.844529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:42:54.845852 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d3d28252-5337-4189-a225-3fda5b18c83c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Returning 404 to user: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:42:54.845852 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d3d28252-5337-4189-a225-3fda5b18c83c tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "DELETE /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 404 len: 111 microversion: 2.1 time: 0.035526 Jul 26 16:42:54.846275 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 481/947] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:42:54 2022] DELETE /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:42:54.852873 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-27f01182-0fbe-41e6-b835-bbea9e45d21e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:54.853684 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-27f01182-0fbe-41e6-b835-bbea9e45d21e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: b9b55f3f-7f6d-4179-8574-11cc47c32566] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:54.863415 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-27f01182-0fbe-41e6-b835-bbea9e45d21e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:54.863969 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-27f01182-0fbe-41e6-b835-bbea9e45d21e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:54.864853 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-27f01182-0fbe-41e6-b835-bbea9e45d21e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:54.867997 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-27f01182-0fbe-41e6-b835-bbea9e45d21e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:54.881515 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-27f01182-0fbe-41e6-b835-bbea9e45d21e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] HTTP exception thrown: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-27f01182-0fbe-41e6-b835-bbea9e45d21e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Request method failure captured: Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 HTTP/1.1 Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcv7-GmZsMqMa81asrWjNYj6jdoX11buhSIm9RcdQ2qbZIRmMCqA0pySeJmN_qiSq7OFWU2YFF_5MAPPnleNIfLISNZ-HPfnJv-puElKaV-C2FD4oydCp3QeaDLUc2O4BRAkA6mJZuwdW5LEm4OLNNoUktqP-zeYvzl2cWuGeMLee0 Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:42:54.883430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/4088561009754a839604e3798787d8b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_4088561009754a839604e3798787d8b9", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 1b9d76409f834b478981c0bbc0c3d4b6 Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:54.885293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': 'b9b55f3f-7f6d-4179-8574-11cc47c32566'} Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:42:54.886219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. Jul 26 16:42:54.887711 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:54.889111 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-27f01182-0fbe-41e6-b835-bbea9e45d21e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Returning 404 to user: Instance b9b55f3f-7f6d-4179-8574-11cc47c32566 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:42:54.889869 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-27f01182-0fbe-41e6-b835-bbea9e45d21e tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566" status: 404 len: 111 microversion: 2.1 time: 0.041621 Jul 26 16:42:54.894344 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 467/948] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:54 2022] GET /compute/v2.1/servers/b9b55f3f-7f6d-4179-8574-11cc47c32566 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:42:55.510495 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5a410677-9b61-47d5-8a17-6855fb6a23ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:55.511233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5a410677-9b61-47d5-8a17-6855fb6a23ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:55.517846 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a410677-9b61-47d5-8a17-6855fb6a23ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:55.518297 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a410677-9b61-47d5-8a17-6855fb6a23ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:55.519056 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a410677-9b61-47d5-8a17-6855fb6a23ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:55.519518 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a410677-9b61-47d5-8a17-6855fb6a23ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:55.652990 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5a410677-9b61-47d5-8a17-6855fb6a23ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:55.661816 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5a410677-9b61-47d5-8a17-6855fb6a23ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:55.663392 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5a410677-9b61-47d5-8a17-6855fb6a23ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:55.664568 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5a410677-9b61-47d5-8a17-6855fb6a23ea tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.158039 Jul 26 16:42:55.665328 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 482/949] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:55 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:56.689549 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-83292fec-906b-479b-9861-0a56a83588b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:56.690196 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-83292fec-906b-479b-9861-0a56a83588b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:56.697052 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-83292fec-906b-479b-9861-0a56a83588b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:56.697508 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-83292fec-906b-479b-9861-0a56a83588b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:56.698296 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-83292fec-906b-479b-9861-0a56a83588b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:56.698750 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-83292fec-906b-479b-9861-0a56a83588b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:56.831480 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-83292fec-906b-479b-9861-0a56a83588b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:56.839629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-83292fec-906b-479b-9861-0a56a83588b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:56.841184 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-83292fec-906b-479b-9861-0a56a83588b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:56.842380 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-83292fec-906b-479b-9861-0a56a83588b1 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.157712 Jul 26 16:42:56.842933 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 468/950] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:56 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:57.142490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1246961764", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-828638125", "security_groups": [{"name": "tempest-secgroup-smoke-1873328593"}], "block_device_mapping_v2": [{"uuid": "c5bad96c-a83d-493f-a673-c1b9efc30de5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f248d137-b4b6-4a4b-82ad-d9d4bbbe5d97"}]}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:42:57.151297 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6be48db4-047b-411c-841a-4c180b3bf383 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27904b65-4a4a-4cbf-a23d-d72fd24aa8bc", "device": "/dev/sdb"}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:42:57.156112 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6be48db4-047b-411c-841a-4c180b3bf383 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:57.161890 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6be48db4-047b-411c-841a-4c180b3bf383 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:57.162356 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6be48db4-047b-411c-841a-4c180b3bf383 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:57.163133 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6be48db4-047b-411c-841a-4c180b3bf383 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:57.163571 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6be48db4-047b-411c-841a-4c180b3bf383 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:57.262635 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] validate_networks() for [('f248d137-b4b6-4a4b-82ad-d9d4bbbe5d97', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:42:57.654352 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:42:57.654772 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:42:57.655236 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:42:57.655637 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:42:57.656038 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:42:57.667182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:57.667621 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:57.668437 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:57.668999 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:57.685161 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Getting quotas for project 94684df47fe14e55af2e72ab5d2ddc48. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:42:57.689108 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Getting quotas for user ea4ccbb465094f079dcc4ca3bcac59cb and project 94684df47fe14e55af2e72ab5d2ddc48. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:42:57.744992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:42:57.747113 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5bad96c-a83d-493f-a673-c1b9efc30de5',volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:42:58.052246 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6be48db4-047b-411c-841a-4c180b3bf383 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "POST /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.904701 Jul 26 16:42:58.054418 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 469/951] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:42:57 2022] POST /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140/os-volume_attachments => generated 194 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:42:58.060799 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0a184cae-3abb-45c7-b9db-b7cef449bd4f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:58.061424 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0a184cae-3abb-45c7-b9db-b7cef449bd4f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:58.067353 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:42:58.069433 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0a184cae-3abb-45c7-b9db-b7cef449bd4f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:58.070064 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0a184cae-3abb-45c7-b9db-b7cef449bd4f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:58.071045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0a184cae-3abb-45c7-b9db-b7cef449bd4f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:58.071627 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0a184cae-3abb-45c7-b9db-b7cef449bd4f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:58.086451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-0a184cae-3abb-45c7-b9db-b7cef449bd4f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] HTTP exception thrown: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0a184cae-3abb-45c7-b9db-b7cef449bd4f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Request method failure captured: Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: DELETE /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 HTTP/1.1 Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcv7-GmZsMqMa81asrWjNYj6jdoX11buhSIm9RcdQ2qbZIRmMCqA0pySeJmN_qiSq7OFWU2YFF_5MAPPnleNIfLISNZ-HPfnJv-puElKaV-C2FD4oydCp3QeaDLUc2O4BRAkA6mJZuwdW5LEm4OLNNoUktqP-zeYvzl2cWuGeMLee0 Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:42:58.088150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/4088561009754a839604e3798787d8b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_4088561009754a839604e3798787d8b9", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 1b9d76409f834b478981c0bbc0c3d4b6 Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:42:58.089642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '4a999303-ed3e-4e86-b4f3-4d04e1aec162'} Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:42:58.090421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:42:58.091681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:58.092925 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0a184cae-3abb-45c7-b9db-b7cef449bd4f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Returning 404 to user: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:42:58.092925 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0a184cae-3abb-45c7-b9db-b7cef449bd4f tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "DELETE /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 404 len: 111 microversion: 2.1 time: 0.035231 Jul 26 16:42:58.092925 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 470/952] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:42:58 2022] DELETE /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:42:58.095190 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-17342c59-cb19-4f24-9fac-c04cfd0ab3c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:58.095743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-17342c59-cb19-4f24-9fac-c04cfd0ab3c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:58.101877 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17342c59-cb19-4f24-9fac-c04cfd0ab3c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:58.102327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17342c59-cb19-4f24-9fac-c04cfd0ab3c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:58.103113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17342c59-cb19-4f24-9fac-c04cfd0ab3c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:58.103547 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17342c59-cb19-4f24-9fac-c04cfd0ab3c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:58.235890 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-17342c59-cb19-4f24-9fac-c04cfd0ab3c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:58.244191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-17342c59-cb19-4f24-9fac-c04cfd0ab3c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:58.245761 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-17342c59-cb19-4f24-9fac-c04cfd0ab3c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:58.246949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-17342c59-cb19-4f24-9fac-c04cfd0ab3c9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1743 microversion: 2.20 time: 0.155626 Jul 26 16:42:58.247702 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 471/953] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:58 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:58.253855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-17eb4b06-a8bc-4ac2-b8ef-96def4b04923 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:58.255531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-17eb4b06-a8bc-4ac2-b8ef-96def4b04923 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] [instance: 4a999303-ed3e-4e86-b4f3-4d04e1aec162] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:58.256992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1f633aeb-029f-472e-bd6c-68a0e45930a0 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.120964 Jul 26 16:42:58.257631 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 483/954] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:42:57 2022] POST /compute/v2.1/servers => generated 408 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:42:58.262966 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17eb4b06-a8bc-4ac2-b8ef-96def4b04923 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:58.272681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17eb4b06-a8bc-4ac2-b8ef-96def4b04923 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:58.272681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17eb4b06-a8bc-4ac2-b8ef-96def4b04923 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:58.272681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-17eb4b06-a8bc-4ac2-b8ef-96def4b04923 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:58.278875 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dea74523-b73e-4cdf-a395-850d4ebc1454 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:58.279425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dea74523-b73e-4cdf-a395-850d4ebc1454 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:58.280160 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-17eb4b06-a8bc-4ac2-b8ef-96def4b04923 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] HTTP exception thrown: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-17eb4b06-a8bc-4ac2-b8ef-96def4b04923 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Request method failure captured: Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 HTTP/1.1 Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcv7-GmZsMqMa81asrWjNYj6jdoX11buhSIm9RcdQ2qbZIRmMCqA0pySeJmN_qiSq7OFWU2YFF_5MAPPnleNIfLISNZ-HPfnJv-puElKaV-C2FD4oydCp3QeaDLUc2O4BRAkA6mJZuwdW5LEm4OLNNoUktqP-zeYvzl2cWuGeMLee0 Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:42:58.282203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/4088561009754a839604e3798787d8b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/4088561009754a839604e3798787d8b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_4088561009754a839604e3798787d8b9", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 4088561009754a839604e3798787d8b9 Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeTestJSON-32368049 Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 1b9d76409f834b478981c0bbc0c3d4b6 Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeTestJSON-32368049-project Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:42:58.284028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '4a999303-ed3e-4e86-b4f3-4d04e1aec162'} Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:42:58.284871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. Jul 26 16:42:58.286470 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:42:58.289183 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-17eb4b06-a8bc-4ac2-b8ef-96def4b04923 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] Returning 404 to user: Instance 4a999303-ed3e-4e86-b4f3-4d04e1aec162 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:42:58.289879 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-17eb4b06-a8bc-4ac2-b8ef-96def4b04923 tempest-AttachVolumeTestJSON-32368049 tempest-AttachVolumeTestJSON-32368049-project] 10.222.0.144 "GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162" status: 404 len: 111 microversion: 2.1 time: 0.041475 Jul 26 16:42:58.290587 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 472/955] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:58 2022] GET /compute/v2.1/servers/4a999303-ed3e-4e86-b4f3-4d04e1aec162 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:42:58.357279 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-dea74523-b73e-4cdf-a395-850d4ebc1454 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:58.368891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dea74523-b73e-4cdf-a395-850d4ebc1454 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1097 microversion: 2.1 time: 0.094576 Jul 26 16:42:58.371803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 484/956] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:58 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1097 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:42:59.270217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e3fc0321-c9b0-40ae-a5d1-7702af90c11a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:59.270819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e3fc0321-c9b0-40ae-a5d1-7702af90c11a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:59.277530 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3fc0321-c9b0-40ae-a5d1-7702af90c11a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:59.277987 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3fc0321-c9b0-40ae-a5d1-7702af90c11a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:59.278755 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3fc0321-c9b0-40ae-a5d1-7702af90c11a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:42:59.279272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e3fc0321-c9b0-40ae-a5d1-7702af90c11a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:42:59.398882 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ae490377-20a5-4403-8a62-d7926b6b5b08 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:42:59.401951 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ae490377-20a5-4403-8a62-d7926b6b5b08 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:42:59.439855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e3fc0321-c9b0-40ae-a5d1-7702af90c11a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:59.448511 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e3fc0321-c9b0-40ae-a5d1-7702af90c11a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:59.450039 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e3fc0321-c9b0-40ae-a5d1-7702af90c11a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:59.451230 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e3fc0321-c9b0-40ae-a5d1-7702af90c11a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1725 microversion: 2.20 time: 0.185457 Jul 26 16:42:59.451785 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 473/957] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:42:59 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:42:59.470805 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ae490377-20a5-4403-8a62-d7926b6b5b08 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:42:59.477790 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ae490377-20a5-4403-8a62-d7926b6b5b08 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1097 microversion: 2.1 time: 0.082709 Jul 26 16:42:59.478447 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 485/958] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:42:59 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1097 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:43:00.474982 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-73dfb6ca-f35d-48a9-a6dd-d6d87c9420fe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:00.475591 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-73dfb6ca-f35d-48a9-a6dd-d6d87c9420fe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:00.482422 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-73dfb6ca-f35d-48a9-a6dd-d6d87c9420fe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:00.482748 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-73dfb6ca-f35d-48a9-a6dd-d6d87c9420fe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:00.483521 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-73dfb6ca-f35d-48a9-a6dd-d6d87c9420fe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:00.483960 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-73dfb6ca-f35d-48a9-a6dd-d6d87c9420fe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:00.499065 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4264d6ed-750c-46d3-aa23-9bf2594eed1e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:00.499818 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4264d6ed-750c-46d3-aa23-9bf2594eed1e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:00.514372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4264d6ed-750c-46d3-aa23-9bf2594eed1e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:00.514372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4264d6ed-750c-46d3-aa23-9bf2594eed1e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:00.514372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4264d6ed-750c-46d3-aa23-9bf2594eed1e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:00.514372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4264d6ed-750c-46d3-aa23-9bf2594eed1e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:00.606134 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4264d6ed-750c-46d3-aa23-9bf2594eed1e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:00.615020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4264d6ed-750c-46d3-aa23-9bf2594eed1e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1147 microversion: 2.1 time: 0.119100 Jul 26 16:43:00.615852 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 486/959] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:00 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1147 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:00.639043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-73dfb6ca-f35d-48a9-a6dd-d6d87c9420fe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:00.647705 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-73dfb6ca-f35d-48a9-a6dd-d6d87c9420fe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:00.649262 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-73dfb6ca-f35d-48a9-a6dd-d6d87c9420fe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:00.650418 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-73dfb6ca-f35d-48a9-a6dd-d6d87c9420fe tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1725 microversion: 2.20 time: 0.179364 Jul 26 16:43:00.650969 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 474/960] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:00 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:01.638048 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ea59d9d2-c1f9-4b18-91ef-e18f65a99949 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:01.641414 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ea59d9d2-c1f9-4b18-91ef-e18f65a99949 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:01.645532 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:01.650943 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea59d9d2-c1f9-4b18-91ef-e18f65a99949 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:01.651624 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea59d9d2-c1f9-4b18-91ef-e18f65a99949 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:01.653604 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea59d9d2-c1f9-4b18-91ef-e18f65a99949 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:01.654044 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea59d9d2-c1f9-4b18-91ef-e18f65a99949 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:01.676069 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3e8f099f-0bc7-4ce8-bfdd-e115206e6560 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:01.676594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3e8f099f-0bc7-4ce8-bfdd-e115206e6560 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:01.688731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3e8f099f-0bc7-4ce8-bfdd-e115206e6560 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:01.689893 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3e8f099f-0bc7-4ce8-bfdd-e115206e6560 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:01.691112 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3e8f099f-0bc7-4ce8-bfdd-e115206e6560 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:01.691892 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3e8f099f-0bc7-4ce8-bfdd-e115206e6560 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:01.736023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ea59d9d2-c1f9-4b18-91ef-e18f65a99949 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:01.744013 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ea59d9d2-c1f9-4b18-91ef-e18f65a99949 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1195 microversion: 2.1 time: 0.112668 Jul 26 16:43:01.744817 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 487/961] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:01 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1195 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:01.750335 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-c0a6b481-ab21-4db5-8a02-0977856f5e42 req-bbb6419d-0dbd-481a-8927-10bd80bff74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959309a9-7e80-4fa3-a819-5c64c66861e5", "name": "network-vif-unplugged", "status": "completed", "tag": "5e531cc9-c347-49e5-b738-d36aac7e7939"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:43:01.761440 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-c0a6b481-ab21-4db5-8a02-0977856f5e42 req-bbb6419d-0dbd-481a-8927-10bd80bff74e service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:01.762122 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-c0a6b481-ab21-4db5-8a02-0977856f5e42 req-bbb6419d-0dbd-481a-8927-10bd80bff74e service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:01.774217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-c0a6b481-ab21-4db5-8a02-0977856f5e42 req-bbb6419d-0dbd-481a-8927-10bd80bff74e service nova] Creating event network-vif-unplugged:5e531cc9-c347-49e5-b738-d36aac7e7939 for instance 959309a9-7e80-4fa3-a819-5c64c66861e5 on hv-cinder-85104 Jul 26 16:43:01.806949 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-c0a6b481-ab21-4db5-8a02-0977856f5e42 req-bbb6419d-0dbd-481a-8927-10bd80bff74e service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040113 Jul 26 16:43:01.810768 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 488/962] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:43:01.866236 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3e8f099f-0bc7-4ce8-bfdd-e115206e6560 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:01.878459 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3e8f099f-0bc7-4ce8-bfdd-e115206e6560 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:01.879982 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3e8f099f-0bc7-4ce8-bfdd-e115206e6560 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:01.881614 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3e8f099f-0bc7-4ce8-bfdd-e115206e6560 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1728 microversion: 2.20 time: 0.211345 Jul 26 16:43:01.886386 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 475/963] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:01 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:43:01.905034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-45f903ce-18b9-4d96-b480-da24175e99cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fdc160b-33db-4bc1-a043-67b1b819f45a"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:43:01.908984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-45f903ce-18b9-4d96-b480-da24175e99cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:01.914671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-45f903ce-18b9-4d96-b480-da24175e99cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:01.915113 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-45f903ce-18b9-4d96-b480-da24175e99cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:01.915879 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-45f903ce-18b9-4d96-b480-da24175e99cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:01.916305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-45f903ce-18b9-4d96-b480-da24175e99cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:02.772180 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-20f647b8-0442-4ac0-a9a2-115ddb9a9b04 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:02.772743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-20f647b8-0442-4ac0-a9a2-115ddb9a9b04 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:02.781696 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20f647b8-0442-4ac0-a9a2-115ddb9a9b04 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:02.788254 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20f647b8-0442-4ac0-a9a2-115ddb9a9b04 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:02.788254 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20f647b8-0442-4ac0-a9a2-115ddb9a9b04 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:02.788254 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-20f647b8-0442-4ac0-a9a2-115ddb9a9b04 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:02.871223 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-20f647b8-0442-4ac0-a9a2-115ddb9a9b04 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:02.871223 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-20f647b8-0442-4ac0-a9a2-115ddb9a9b04 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1213 microversion: 2.1 time: 0.104846 Jul 26 16:43:02.871797 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 476/964] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:02 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:43:03.208060 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-45f903ce-18b9-4d96-b480-da24175e99cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "POST /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.307513 Jul 26 16:43:03.213427 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 489/965] 10.222.0.144 () {62 vars in 1369 bytes} [Tue Jul 26 16:43:01 2022] POST /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/os-volume_attachments => generated 188 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 26 16:43:03.334206 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e18c1dbd-bf79-4e5b-b2fd-d8f7a0d1521f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:03.334935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e18c1dbd-bf79-4e5b-b2fd-d8f7a0d1521f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:03.341253 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e18c1dbd-bf79-4e5b-b2fd-d8f7a0d1521f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:03.341955 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e18c1dbd-bf79-4e5b-b2fd-d8f7a0d1521f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:03.342739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e18c1dbd-bf79-4e5b-b2fd-d8f7a0d1521f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:03.343173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e18c1dbd-bf79-4e5b-b2fd-d8f7a0d1521f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:03.892618 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4ed7d189-00b3-4bae-98c3-9289a22d724b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:03.893237 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4ed7d189-00b3-4bae-98c3-9289a22d724b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:03.899952 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4ed7d189-00b3-4bae-98c3-9289a22d724b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:03.900432 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4ed7d189-00b3-4bae-98c3-9289a22d724b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:03.901456 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4ed7d189-00b3-4bae-98c3-9289a22d724b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:03.901891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4ed7d189-00b3-4bae-98c3-9289a22d724b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:04.050939 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4ed7d189-00b3-4bae-98c3-9289a22d724b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:04.058353 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4ed7d189-00b3-4bae-98c3-9289a22d724b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1281 microversion: 2.1 time: 0.170131 Jul 26 16:43:04.060309 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 490/966] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:03 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:43:04.197758 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e18c1dbd-bf79-4e5b-b2fd-d8f7a0d1521f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "DELETE /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/os-volume_attachments/3fdc160b-33db-4bc1-a043-67b1b819f45a" status: 202 len: 0 microversion: 2.20 time: 0.866810 Jul 26 16:43:04.198527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 477/967] 10.222.0.144 () {60 vars in 1462 bytes} [Tue Jul 26 16:43:03 2022] DELETE /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/os-volume_attachments/3fdc160b-33db-4bc1-a043-67b1b819f45a => generated 0 bytes in 869 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:43:04.263924 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3d1684a2-7828-4d58-ad09-3d376776b2a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:43:04.264607 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3d1684a2-7828-4d58-ad09-3d376776b2a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:04.271390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3d1684a2-7828-4d58-ad09-3d376776b2a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:04.274559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3d1684a2-7828-4d58-ad09-3d376776b2a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:04.274559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3d1684a2-7828-4d58-ad09-3d376776b2a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:04.275975 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3d1684a2-7828-4d58-ad09-3d376776b2a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:04.523867 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-32cdff7e-846d-45a2-b5e2-907d36a8352f req-236a097a-fb1a-4370-a5e4-664cc9f39066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608fc7e4-4ccf-4823-82af-392b80004b29", "tag": "e4318fe5-e428-4abb-b479-2d426846b89d"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:43:04.540850 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-32cdff7e-846d-45a2-b5e2-907d36a8352f req-236a097a-fb1a-4370-a5e4-664cc9f39066 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:04.541697 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-32cdff7e-846d-45a2-b5e2-907d36a8352f req-236a097a-fb1a-4370-a5e4-664cc9f39066 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:04.555092 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-32cdff7e-846d-45a2-b5e2-907d36a8352f req-236a097a-fb1a-4370-a5e4-664cc9f39066 service nova] Creating event network-changed:e4318fe5-e428-4abb-b479-2d426846b89d for instance 608fc7e4-4ccf-4823-82af-392b80004b29 on hv-cinder-85104 Jul 26 16:43:04.561309 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-32cdff7e-846d-45a2-b5e2-907d36a8352f req-236a097a-fb1a-4370-a5e4-664cc9f39066 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041519 Jul 26 16:43:04.564044 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 478/968] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:43:04.572544 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3d1684a2-7828-4d58-ad09-3d376776b2a2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "POST /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/action" status: 202 len: 0 microversion: 2.20 time: 0.313283 Jul 26 16:43:04.582417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b2ef4bbc-45f3-4e1a-8aab-698cf6901a2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:04.582931 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 491/969] 10.222.0.144 () {62 vars in 1324 bytes} [Tue Jul 26 16:43:04 2022] POST /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:43:04.583554 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b2ef4bbc-45f3-4e1a-8aab-698cf6901a2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:04.598283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b2ef4bbc-45f3-4e1a-8aab-698cf6901a2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:04.599312 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b2ef4bbc-45f3-4e1a-8aab-698cf6901a2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:04.601145 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b2ef4bbc-45f3-4e1a-8aab-698cf6901a2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:04.601788 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b2ef4bbc-45f3-4e1a-8aab-698cf6901a2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:04.772423 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b2ef4bbc-45f3-4e1a-8aab-698cf6901a2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:04.781392 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b2ef4bbc-45f3-4e1a-8aab-698cf6901a2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:04.785355 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b2ef4bbc-45f3-4e1a-8aab-698cf6901a2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:04.791303 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b2ef4bbc-45f3-4e1a-8aab-698cf6901a2b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1676 microversion: 2.20 time: 0.208761 Jul 26 16:43:04.791303 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 479/970] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:04 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1676 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:05.079759 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2462406a-ad42-49ec-a1af-5f056af2dd97 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:05.080367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2462406a-ad42-49ec-a1af-5f056af2dd97 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:05.087151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2462406a-ad42-49ec-a1af-5f056af2dd97 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:05.087650 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2462406a-ad42-49ec-a1af-5f056af2dd97 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:05.089016 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2462406a-ad42-49ec-a1af-5f056af2dd97 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:05.089455 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2462406a-ad42-49ec-a1af-5f056af2dd97 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:05.604496 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2462406a-ad42-49ec-a1af-5f056af2dd97 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:05.613570 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2462406a-ad42-49ec-a1af-5f056af2dd97 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1281 microversion: 2.1 time: 0.538134 Jul 26 16:43:05.614475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 492/971] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:05 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1281 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:05.810923 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d98381cd-62c8-4fd4-be18-0b89e955fd79 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:05.812258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d98381cd-62c8-4fd4-be18-0b89e955fd79 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:05.820702 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d98381cd-62c8-4fd4-be18-0b89e955fd79 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:05.821180 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d98381cd-62c8-4fd4-be18-0b89e955fd79 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:05.821946 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d98381cd-62c8-4fd4-be18-0b89e955fd79 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:05.822378 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d98381cd-62c8-4fd4-be18-0b89e955fd79 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:05.969890 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d98381cd-62c8-4fd4-be18-0b89e955fd79 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:05.978526 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d98381cd-62c8-4fd4-be18-0b89e955fd79 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:05.980059 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d98381cd-62c8-4fd4-be18-0b89e955fd79 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:05.985843 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d98381cd-62c8-4fd4-be18-0b89e955fd79 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1676 microversion: 2.20 time: 0.174271 Jul 26 16:43:05.986430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 480/972] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:05 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:06.636071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-1079aabd-78be-42df-89d5-e8717bec27be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:06.636709 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-1079aabd-78be-42df-89d5-e8717bec27be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:06.643890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1079aabd-78be-42df-89d5-e8717bec27be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:06.644559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1079aabd-78be-42df-89d5-e8717bec27be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:06.645107 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1079aabd-78be-42df-89d5-e8717bec27be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:06.645537 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-1079aabd-78be-42df-89d5-e8717bec27be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:06.784336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-1079aabd-78be-42df-89d5-e8717bec27be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:06.791863 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-1079aabd-78be-42df-89d5-e8717bec27be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1281 microversion: 2.1 time: 0.159606 Jul 26 16:43:06.792457 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 493/973] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:06 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1281 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:07.009045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-389a6709-ca89-4e0d-a20f-7fbae565d5e7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:07.009657 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-389a6709-ca89-4e0d-a20f-7fbae565d5e7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:07.016989 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-389a6709-ca89-4e0d-a20f-7fbae565d5e7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:07.017442 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-389a6709-ca89-4e0d-a20f-7fbae565d5e7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:07.018466 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-389a6709-ca89-4e0d-a20f-7fbae565d5e7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:07.018905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-389a6709-ca89-4e0d-a20f-7fbae565d5e7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:07.166582 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-389a6709-ca89-4e0d-a20f-7fbae565d5e7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:07.176647 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-389a6709-ca89-4e0d-a20f-7fbae565d5e7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:07.178688 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-389a6709-ca89-4e0d-a20f-7fbae565d5e7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:07.182091 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-389a6709-ca89-4e0d-a20f-7fbae565d5e7 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1678 microversion: 2.20 time: 0.176910 Jul 26 16:43:07.183041 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 481/974] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:07 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:07.815001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-925cc098-b65f-47db-b0fe-159f0691cc54 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:07.815627 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-925cc098-b65f-47db-b0fe-159f0691cc54 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:07.819986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:07.839992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-925cc098-b65f-47db-b0fe-159f0691cc54 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:07.840468 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-925cc098-b65f-47db-b0fe-159f0691cc54 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:07.844056 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-925cc098-b65f-47db-b0fe-159f0691cc54 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:07.847223 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-925cc098-b65f-47db-b0fe-159f0691cc54 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:07.857386 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:08.125827 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-925cc098-b65f-47db-b0fe-159f0691cc54 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:08.133110 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-925cc098-b65f-47db-b0fe-159f0691cc54 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1281 microversion: 2.1 time: 0.324492 Jul 26 16:43:08.133672 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 494/975] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:07 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1281 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:08.211094 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-702365e2-bf4d-4ac2-bdbf-f2f6519d5c6c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:08.211706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-702365e2-bf4d-4ac2-bdbf-f2f6519d5c6c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:08.218524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-702365e2-bf4d-4ac2-bdbf-f2f6519d5c6c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:08.218984 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-702365e2-bf4d-4ac2-bdbf-f2f6519d5c6c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:08.220329 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-702365e2-bf4d-4ac2-bdbf-f2f6519d5c6c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:08.220856 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-702365e2-bf4d-4ac2-bdbf-f2f6519d5c6c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:08.224960 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:08.406357 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-702365e2-bf4d-4ac2-bdbf-f2f6519d5c6c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:08.415787 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-702365e2-bf4d-4ac2-bdbf-f2f6519d5c6c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:08.417321 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-702365e2-bf4d-4ac2-bdbf-f2f6519d5c6c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:08.418484 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-702365e2-bf4d-4ac2-bdbf-f2f6519d5c6c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.211363 Jul 26 16:43:08.419093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 482/976] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:08 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:09.154467 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fdbff479-04b9-4ab7-b639-c98a6c30b92b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:09.155079 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fdbff479-04b9-4ab7-b639-c98a6c30b92b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:09.162167 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fdbff479-04b9-4ab7-b639-c98a6c30b92b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:09.162616 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fdbff479-04b9-4ab7-b639-c98a6c30b92b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:09.163406 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fdbff479-04b9-4ab7-b639-c98a6c30b92b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:09.163842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fdbff479-04b9-4ab7-b639-c98a6c30b92b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:09.308322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fdbff479-04b9-4ab7-b639-c98a6c30b92b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:09.324041 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fdbff479-04b9-4ab7-b639-c98a6c30b92b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.173517 Jul 26 16:43:09.325472 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 495/977] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:09 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:09.452780 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9c88f644-5b11-4d06-897a-74ab9bb8a313 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:09.453463 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9c88f644-5b11-4d06-897a-74ab9bb8a313 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:09.460901 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9c88f644-5b11-4d06-897a-74ab9bb8a313 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:09.461338 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9c88f644-5b11-4d06-897a-74ab9bb8a313 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:09.462113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9c88f644-5b11-4d06-897a-74ab9bb8a313 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:09.462548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9c88f644-5b11-4d06-897a-74ab9bb8a313 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:09.639014 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9c88f644-5b11-4d06-897a-74ab9bb8a313 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:09.650252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9c88f644-5b11-4d06-897a-74ab9bb8a313 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:09.651996 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9c88f644-5b11-4d06-897a-74ab9bb8a313 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:09.653169 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9c88f644-5b11-4d06-897a-74ab9bb8a313 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.204511 Jul 26 16:43:09.653722 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 483/978] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:09 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:10.345520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-004c3376-bd45-4083-8016-b67b05b22d25 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:10.354121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-004c3376-bd45-4083-8016-b67b05b22d25 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:10.354121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=10 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:10.354121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-004c3376-bd45-4083-8016-b67b05b22d25 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:10.354121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-004c3376-bd45-4083-8016-b67b05b22d25 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:10.354983 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-004c3376-bd45-4083-8016-b67b05b22d25 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:10.355306 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-004c3376-bd45-4083-8016-b67b05b22d25 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:10.646524 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-004c3376-bd45-4083-8016-b67b05b22d25 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:10.653858 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-004c3376-bd45-4083-8016-b67b05b22d25 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.312150 Jul 26 16:43:10.654390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 496/979] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:10 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:10.677525 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fc421881-e81b-4447-b051-764ad6ebf0e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:10.678157 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fc421881-e81b-4447-b051-764ad6ebf0e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:10.685057 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc421881-e81b-4447-b051-764ad6ebf0e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:10.691227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc421881-e81b-4447-b051-764ad6ebf0e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:10.691227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc421881-e81b-4447-b051-764ad6ebf0e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:10.691227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fc421881-e81b-4447-b051-764ad6ebf0e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:10.819143 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fc421881-e81b-4447-b051-764ad6ebf0e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:10.828645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fc421881-e81b-4447-b051-764ad6ebf0e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:10.828888 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fc421881-e81b-4447-b051-764ad6ebf0e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:10.830085 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fc421881-e81b-4447-b051-764ad6ebf0e6 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.157403 Jul 26 16:43:10.830637 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 484/980] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:10 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:11.675244 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-bd41ab81-8333-4cbb-a6f0-57ef80b0a382 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:11.676319 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-bd41ab81-8333-4cbb-a6f0-57ef80b0a382 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:11.684397 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd41ab81-8333-4cbb-a6f0-57ef80b0a382 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:11.684838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd41ab81-8333-4cbb-a6f0-57ef80b0a382 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:11.685598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd41ab81-8333-4cbb-a6f0-57ef80b0a382 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:11.686025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-bd41ab81-8333-4cbb-a6f0-57ef80b0a382 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:11.826988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-bd41ab81-8333-4cbb-a6f0-57ef80b0a382 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:11.834933 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-bd41ab81-8333-4cbb-a6f0-57ef80b0a382 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.163811 Jul 26 16:43:11.835478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 497/981] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:11 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:11.853999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c3865d38-bb4a-4458-8aec-3afd5df40e8c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:11.854914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c3865d38-bb4a-4458-8aec-3afd5df40e8c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:11.861138 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c3865d38-bb4a-4458-8aec-3afd5df40e8c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:11.861585 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c3865d38-bb4a-4458-8aec-3afd5df40e8c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:11.862335 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c3865d38-bb4a-4458-8aec-3afd5df40e8c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:11.862769 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c3865d38-bb4a-4458-8aec-3afd5df40e8c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:11.998178 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c3865d38-bb4a-4458-8aec-3afd5df40e8c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:12.007215 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c3865d38-bb4a-4458-8aec-3afd5df40e8c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:12.008756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c3865d38-bb4a-4458-8aec-3afd5df40e8c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:12.009907 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c3865d38-bb4a-4458-8aec-3afd5df40e8c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.160145 Jul 26 16:43:12.010446 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 485/982] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:11 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:12.856618 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-41bf3004-28cc-4995-a6b0-a389f2087a5a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:12.857135 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-41bf3004-28cc-4995-a6b0-a389f2087a5a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:12.864113 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41bf3004-28cc-4995-a6b0-a389f2087a5a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:12.864598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41bf3004-28cc-4995-a6b0-a389f2087a5a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:12.865352 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41bf3004-28cc-4995-a6b0-a389f2087a5a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:12.865780 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41bf3004-28cc-4995-a6b0-a389f2087a5a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:12.997561 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-41bf3004-28cc-4995-a6b0-a389f2087a5a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:13.004903 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-41bf3004-28cc-4995-a6b0-a389f2087a5a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.152325 Jul 26 16:43:13.005448 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 498/983] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:12 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:13.034347 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bb4033e8-fcc1-4cef-a237-c8761731bf04 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:13.034949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bb4033e8-fcc1-4cef-a237-c8761731bf04 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:13.041341 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bb4033e8-fcc1-4cef-a237-c8761731bf04 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:13.041786 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bb4033e8-fcc1-4cef-a237-c8761731bf04 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:13.042536 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bb4033e8-fcc1-4cef-a237-c8761731bf04 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:13.042964 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bb4033e8-fcc1-4cef-a237-c8761731bf04 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:13.170983 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bb4033e8-fcc1-4cef-a237-c8761731bf04 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:13.187955 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bb4033e8-fcc1-4cef-a237-c8761731bf04 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:13.189497 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bb4033e8-fcc1-4cef-a237-c8761731bf04 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:13.190696 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bb4033e8-fcc1-4cef-a237-c8761731bf04 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.161004 Jul 26 16:43:13.191268 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 486/984] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:13 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:43:14.034633 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-80375dd6-c2c8-43da-a557-cd684c95ef40 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:14.034633 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-80375dd6-c2c8-43da-a557-cd684c95ef40 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:14.034633 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80375dd6-c2c8-43da-a557-cd684c95ef40 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:14.034633 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80375dd6-c2c8-43da-a557-cd684c95ef40 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:14.035399 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80375dd6-c2c8-43da-a557-cd684c95ef40 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:14.035399 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-80375dd6-c2c8-43da-a557-cd684c95ef40 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:14.175704 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-80375dd6-c2c8-43da-a557-cd684c95ef40 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:14.183899 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-80375dd6-c2c8-43da-a557-cd684c95ef40 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.162483 Jul 26 16:43:14.197372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 499/985] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:14 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:14.213244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7cd23d4f-21d9-4657-89f1-abdc5f713dfc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:14.213855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7cd23d4f-21d9-4657-89f1-abdc5f713dfc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:14.220553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7cd23d4f-21d9-4657-89f1-abdc5f713dfc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:14.221010 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7cd23d4f-21d9-4657-89f1-abdc5f713dfc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:14.221777 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7cd23d4f-21d9-4657-89f1-abdc5f713dfc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:14.222216 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7cd23d4f-21d9-4657-89f1-abdc5f713dfc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:14.362030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7cd23d4f-21d9-4657-89f1-abdc5f713dfc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:14.370272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7cd23d4f-21d9-4657-89f1-abdc5f713dfc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:14.371777 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7cd23d4f-21d9-4657-89f1-abdc5f713dfc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:14.372994 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7cd23d4f-21d9-4657-89f1-abdc5f713dfc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.163610 Jul 26 16:43:14.373607 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 487/986] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:14 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:15.215523 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-db64b801-0db7-4ada-92d6-6dabb7e14880 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:15.216155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-db64b801-0db7-4ada-92d6-6dabb7e14880 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:15.222836 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db64b801-0db7-4ada-92d6-6dabb7e14880 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:15.223284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db64b801-0db7-4ada-92d6-6dabb7e14880 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:15.224045 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db64b801-0db7-4ada-92d6-6dabb7e14880 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:15.224514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db64b801-0db7-4ada-92d6-6dabb7e14880 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:15.379692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-db64b801-0db7-4ada-92d6-6dabb7e14880 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:15.387241 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-db64b801-0db7-4ada-92d6-6dabb7e14880 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.184546 Jul 26 16:43:15.387837 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 500/987] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:15 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:15.397047 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bdaf702c-752b-48bc-ab1c-16a0671fd407 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:15.397763 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bdaf702c-752b-48bc-ab1c-16a0671fd407 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:15.404580 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bdaf702c-752b-48bc-ab1c-16a0671fd407 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:15.405038 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bdaf702c-752b-48bc-ab1c-16a0671fd407 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:15.405800 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bdaf702c-752b-48bc-ab1c-16a0671fd407 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:15.406249 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bdaf702c-752b-48bc-ab1c-16a0671fd407 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:15.538489 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bdaf702c-752b-48bc-ab1c-16a0671fd407 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:15.546764 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bdaf702c-752b-48bc-ab1c-16a0671fd407 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:15.548854 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bdaf702c-752b-48bc-ab1c-16a0671fd407 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:15.550031 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bdaf702c-752b-48bc-ab1c-16a0671fd407 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.156889 Jul 26 16:43:15.550593 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 488/988] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:15 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:16.411136 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-11a0d26a-2a31-42d6-8e4b-f036f9d9af44 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:16.411744 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-11a0d26a-2a31-42d6-8e4b-f036f9d9af44 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:16.418279 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-11a0d26a-2a31-42d6-8e4b-f036f9d9af44 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:16.418721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-11a0d26a-2a31-42d6-8e4b-f036f9d9af44 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:16.419611 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-11a0d26a-2a31-42d6-8e4b-f036f9d9af44 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:16.420082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-11a0d26a-2a31-42d6-8e4b-f036f9d9af44 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:16.574128 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e8c94a86-6261-4e8f-b52b-5521f444d2ca tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:16.585467 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e8c94a86-6261-4e8f-b52b-5521f444d2ca tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:16.592552 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8c94a86-6261-4e8f-b52b-5521f444d2ca tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:16.596057 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8c94a86-6261-4e8f-b52b-5521f444d2ca tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:16.597882 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-11a0d26a-2a31-42d6-8e4b-f036f9d9af44 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:16.599826 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8c94a86-6261-4e8f-b52b-5521f444d2ca tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:16.600687 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8c94a86-6261-4e8f-b52b-5521f444d2ca tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:16.606186 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-11a0d26a-2a31-42d6-8e4b-f036f9d9af44 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.201219 Jul 26 16:43:16.606757 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 501/989] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:16 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:16.805237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e8c94a86-6261-4e8f-b52b-5521f444d2ca tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:16.813637 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e8c94a86-6261-4e8f-b52b-5521f444d2ca tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:16.818337 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e8c94a86-6261-4e8f-b52b-5521f444d2ca tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:16.818337 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e8c94a86-6261-4e8f-b52b-5521f444d2ca tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.246380 Jul 26 16:43:16.818337 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 489/990] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:16 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:43:17.629947 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cf03aa64-f92c-49a7-a30b-43ec4d8e3d3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:17.630553 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-cf03aa64-f92c-49a7-a30b-43ec4d8e3d3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:17.637067 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf03aa64-f92c-49a7-a30b-43ec4d8e3d3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:17.637514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf03aa64-f92c-49a7-a30b-43ec4d8e3d3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:17.638269 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf03aa64-f92c-49a7-a30b-43ec4d8e3d3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:17.638697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cf03aa64-f92c-49a7-a30b-43ec4d8e3d3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:17.803202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-cf03aa64-f92c-49a7-a30b-43ec4d8e3d3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:17.816992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-cf03aa64-f92c-49a7-a30b-43ec4d8e3d3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.190786 Jul 26 16:43:17.819693 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 502/991] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:17 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:17.843261 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-55201e02-2e10-4bcc-b91d-b667be750706 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:17.845421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-55201e02-2e10-4bcc-b91d-b667be750706 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:17.853859 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-55201e02-2e10-4bcc-b91d-b667be750706 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:17.854602 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-55201e02-2e10-4bcc-b91d-b667be750706 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:17.855940 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-55201e02-2e10-4bcc-b91d-b667be750706 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:17.856961 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-55201e02-2e10-4bcc-b91d-b667be750706 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:17.995228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-55201e02-2e10-4bcc-b91d-b667be750706 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:18.005138 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-55201e02-2e10-4bcc-b91d-b667be750706 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:18.007142 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-55201e02-2e10-4bcc-b91d-b667be750706 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:18.008757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-55201e02-2e10-4bcc-b91d-b667be750706 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.172520 Jul 26 16:43:18.023052 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 490/992] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:17 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:18.840436 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0c4d2315-7f1d-45b3-ac47-d733b7bfb009 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:18.841676 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0c4d2315-7f1d-45b3-ac47-d733b7bfb009 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:18.848546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0c4d2315-7f1d-45b3-ac47-d733b7bfb009 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:18.849297 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0c4d2315-7f1d-45b3-ac47-d733b7bfb009 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:18.850342 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0c4d2315-7f1d-45b3-ac47-d733b7bfb009 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:18.850986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0c4d2315-7f1d-45b3-ac47-d733b7bfb009 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:19.018582 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0c4d2315-7f1d-45b3-ac47-d733b7bfb009 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:19.032302 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-655a582e-3b77-47bb-98a1-d66015d1e4d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:19.032959 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-655a582e-3b77-47bb-98a1-d66015d1e4d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:19.039025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0c4d2315-7f1d-45b3-ac47-d733b7bfb009 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.202318 Jul 26 16:43:19.041767 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-655a582e-3b77-47bb-98a1-d66015d1e4d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:19.042551 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-655a582e-3b77-47bb-98a1-d66015d1e4d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:19.043323 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-655a582e-3b77-47bb-98a1-d66015d1e4d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:19.043993 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-655a582e-3b77-47bb-98a1-d66015d1e4d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:19.044905 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 503/993] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:18 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:19.215278 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-655a582e-3b77-47bb-98a1-d66015d1e4d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:19.224782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-655a582e-3b77-47bb-98a1-d66015d1e4d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:19.226332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-655a582e-3b77-47bb-98a1-d66015d1e4d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:19.227554 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-655a582e-3b77-47bb-98a1-d66015d1e4d0 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.200240 Jul 26 16:43:19.228095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 491/994] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:19 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:43:20.063070 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a1ac68d5-f28a-474a-b8a9-b633748ac131 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:20.063842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a1ac68d5-f28a-474a-b8a9-b633748ac131 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:20.070814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1ac68d5-f28a-474a-b8a9-b633748ac131 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:20.071256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1ac68d5-f28a-474a-b8a9-b633748ac131 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:20.072020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1ac68d5-f28a-474a-b8a9-b633748ac131 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:20.072476 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1ac68d5-f28a-474a-b8a9-b633748ac131 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:20.246156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a1ac68d5-f28a-474a-b8a9-b633748ac131 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:20.256096 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-32c11c12-56f3-4e67-b6e8-97e7db4754e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:20.256773 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-32c11c12-56f3-4e67-b6e8-97e7db4754e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:20.260101 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a1ac68d5-f28a-474a-b8a9-b633748ac131 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.200535 Jul 26 16:43:20.273708 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 504/995] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:20 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:20.287056 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32c11c12-56f3-4e67-b6e8-97e7db4754e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:20.287440 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32c11c12-56f3-4e67-b6e8-97e7db4754e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:20.288230 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32c11c12-56f3-4e67-b6e8-97e7db4754e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:20.288696 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-32c11c12-56f3-4e67-b6e8-97e7db4754e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:20.470046 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-32c11c12-56f3-4e67-b6e8-97e7db4754e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:20.480504 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-32c11c12-56f3-4e67-b6e8-97e7db4754e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:20.482409 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-32c11c12-56f3-4e67-b6e8-97e7db4754e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:20.489039 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-32c11c12-56f3-4e67-b6e8-97e7db4754e9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.239615 Jul 26 16:43:20.497040 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 492/996] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:20 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:21.286984 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b09e3da4-8566-4998-91b9-84f6c2077c27 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:21.287722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b09e3da4-8566-4998-91b9-84f6c2077c27 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:21.295683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b09e3da4-8566-4998-91b9-84f6c2077c27 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:21.296133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b09e3da4-8566-4998-91b9-84f6c2077c27 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:21.296954 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b09e3da4-8566-4998-91b9-84f6c2077c27 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:21.297385 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b09e3da4-8566-4998-91b9-84f6c2077c27 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:21.436262 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b09e3da4-8566-4998-91b9-84f6c2077c27 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:21.444364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b09e3da4-8566-4998-91b9-84f6c2077c27 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.162286 Jul 26 16:43:21.444952 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 505/997] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:21 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:21.512334 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-60f43947-b2da-44b1-a294-3151c527d225 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:21.512969 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-60f43947-b2da-44b1-a294-3151c527d225 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:21.519479 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-60f43947-b2da-44b1-a294-3151c527d225 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:21.519933 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-60f43947-b2da-44b1-a294-3151c527d225 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:21.520779 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-60f43947-b2da-44b1-a294-3151c527d225 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:21.521218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-60f43947-b2da-44b1-a294-3151c527d225 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:21.655469 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-60f43947-b2da-44b1-a294-3151c527d225 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:21.663781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-60f43947-b2da-44b1-a294-3151c527d225 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:21.665328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-60f43947-b2da-44b1-a294-3151c527d225 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:21.666521 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-60f43947-b2da-44b1-a294-3151c527d225 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.158047 Jul 26 16:43:21.667076 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 493/998] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:21 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:22.464948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d9b571e9-c0e7-4390-ae25-c50c77993374 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:22.465561 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d9b571e9-c0e7-4390-ae25-c50c77993374 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:22.472703 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d9b571e9-c0e7-4390-ae25-c50c77993374 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:22.473161 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d9b571e9-c0e7-4390-ae25-c50c77993374 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:22.473949 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d9b571e9-c0e7-4390-ae25-c50c77993374 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:22.474390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d9b571e9-c0e7-4390-ae25-c50c77993374 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:22.622229 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d9b571e9-c0e7-4390-ae25-c50c77993374 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:22.630456 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d9b571e9-c0e7-4390-ae25-c50c77993374 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.169293 Jul 26 16:43:22.631006 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 506/999] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:22 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:22.696307 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d924b45e-41d0-42d1-93e6-791ee73a0adc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:22.696925 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d924b45e-41d0-42d1-93e6-791ee73a0adc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:22.705340 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d924b45e-41d0-42d1-93e6-791ee73a0adc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:22.706079 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d924b45e-41d0-42d1-93e6-791ee73a0adc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:22.707085 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d924b45e-41d0-42d1-93e6-791ee73a0adc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:22.707552 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d924b45e-41d0-42d1-93e6-791ee73a0adc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:22.869081 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d924b45e-41d0-42d1-93e6-791ee73a0adc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:22.878629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d924b45e-41d0-42d1-93e6-791ee73a0adc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:22.880129 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d924b45e-41d0-42d1-93e6-791ee73a0adc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:22.881369 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d924b45e-41d0-42d1-93e6-791ee73a0adc tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.189346 Jul 26 16:43:22.881942 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 494/1000] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:22 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:23.651445 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-621bea24-3f99-4393-8414-f18cc7626e4a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:23.653027 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-621bea24-3f99-4393-8414-f18cc7626e4a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:23.660582 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-621bea24-3f99-4393-8414-f18cc7626e4a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:23.661030 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-621bea24-3f99-4393-8414-f18cc7626e4a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:23.661804 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-621bea24-3f99-4393-8414-f18cc7626e4a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:23.662663 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-621bea24-3f99-4393-8414-f18cc7626e4a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:23.815762 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-621bea24-3f99-4393-8414-f18cc7626e4a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:23.823961 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-621bea24-3f99-4393-8414-f18cc7626e4a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.176307 Jul 26 16:43:23.824824 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 507/1001] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:23 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:23.904841 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d33bd8df-db92-46de-805a-eb6b548142f3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:23.905549 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d33bd8df-db92-46de-805a-eb6b548142f3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:23.913655 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d33bd8df-db92-46de-805a-eb6b548142f3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:23.914113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d33bd8df-db92-46de-805a-eb6b548142f3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:23.914918 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d33bd8df-db92-46de-805a-eb6b548142f3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:23.915347 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d33bd8df-db92-46de-805a-eb6b548142f3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:24.071389 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d33bd8df-db92-46de-805a-eb6b548142f3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:24.084805 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d33bd8df-db92-46de-805a-eb6b548142f3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:24.084805 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d33bd8df-db92-46de-805a-eb6b548142f3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:24.084805 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d33bd8df-db92-46de-805a-eb6b548142f3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.181804 Jul 26 16:43:24.085245 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 495/1002] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:23 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:24.869838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-17702972-2229-411a-872b-de567f52e386 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:24.869838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-17702972-2229-411a-872b-de567f52e386 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:24.869838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-17702972-2229-411a-872b-de567f52e386 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:24.869838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-17702972-2229-411a-872b-de567f52e386 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:24.870931 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-17702972-2229-411a-872b-de567f52e386 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:24.870931 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-17702972-2229-411a-872b-de567f52e386 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:25.004486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-17702972-2229-411a-872b-de567f52e386 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:25.017531 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-17702972-2229-411a-872b-de567f52e386 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.176045 Jul 26 16:43:25.029871 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 508/1003] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:24 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:25.106415 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9deeafb4-8d1f-4088-ba17-6ae60ababf1a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:25.107865 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9deeafb4-8d1f-4088-ba17-6ae60ababf1a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:25.115459 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9deeafb4-8d1f-4088-ba17-6ae60ababf1a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:25.116028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9deeafb4-8d1f-4088-ba17-6ae60ababf1a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:25.116903 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9deeafb4-8d1f-4088-ba17-6ae60ababf1a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:25.117950 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9deeafb4-8d1f-4088-ba17-6ae60ababf1a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:25.261748 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9deeafb4-8d1f-4088-ba17-6ae60ababf1a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:25.269648 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9deeafb4-8d1f-4088-ba17-6ae60ababf1a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:25.271147 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9deeafb4-8d1f-4088-ba17-6ae60ababf1a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:25.272300 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9deeafb4-8d1f-4088-ba17-6ae60ababf1a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.170321 Jul 26 16:43:25.272887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 496/1004] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:25 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:26.043023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6e9ac240-e6ad-4c73-8e06-bf7a2deac559 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:26.043617 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6e9ac240-e6ad-4c73-8e06-bf7a2deac559 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:26.050551 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6e9ac240-e6ad-4c73-8e06-bf7a2deac559 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:26.051839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6e9ac240-e6ad-4c73-8e06-bf7a2deac559 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:26.053025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6e9ac240-e6ad-4c73-8e06-bf7a2deac559 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:26.053664 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6e9ac240-e6ad-4c73-8e06-bf7a2deac559 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:26.201689 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6e9ac240-e6ad-4c73-8e06-bf7a2deac559 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:26.209662 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6e9ac240-e6ad-4c73-8e06-bf7a2deac559 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.173010 Jul 26 16:43:26.210214 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 509/1005] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:26 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:26.295135 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a0e8dd43-3cb1-48aa-858b-541d83576851 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:26.295766 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a0e8dd43-3cb1-48aa-858b-541d83576851 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:26.302421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a0e8dd43-3cb1-48aa-858b-541d83576851 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:26.308275 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a0e8dd43-3cb1-48aa-858b-541d83576851 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:26.308275 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a0e8dd43-3cb1-48aa-858b-541d83576851 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:26.308275 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a0e8dd43-3cb1-48aa-858b-541d83576851 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:26.695013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a0e8dd43-3cb1-48aa-858b-541d83576851 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:26.703135 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a0e8dd43-3cb1-48aa-858b-541d83576851 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:26.709197 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a0e8dd43-3cb1-48aa-858b-541d83576851 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:26.709197 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a0e8dd43-3cb1-48aa-858b-541d83576851 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.414531 Jul 26 16:43:26.709197 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 497/1006] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:26 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:27.231178 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2191bf58-442a-4a10-b71d-00489445f189 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:27.231769 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2191bf58-442a-4a10-b71d-00489445f189 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:27.238992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2191bf58-442a-4a10-b71d-00489445f189 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:27.239443 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2191bf58-442a-4a10-b71d-00489445f189 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:27.240207 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2191bf58-442a-4a10-b71d-00489445f189 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:27.240670 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2191bf58-442a-4a10-b71d-00489445f189 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:27.372597 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2191bf58-442a-4a10-b71d-00489445f189 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:27.375980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:27.380336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2191bf58-442a-4a10-b71d-00489445f189 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.153054 Jul 26 16:43:27.380914 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 510/1007] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:27 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:27.728509 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b9495195-fbc0-466c-969a-b307f4e5a1cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:27.729126 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b9495195-fbc0-466c-969a-b307f4e5a1cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:27.736060 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b9495195-fbc0-466c-969a-b307f4e5a1cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:27.736600 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b9495195-fbc0-466c-969a-b307f4e5a1cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:27.737335 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b9495195-fbc0-466c-969a-b307f4e5a1cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:27.737779 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b9495195-fbc0-466c-969a-b307f4e5a1cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:27.872579 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b9495195-fbc0-466c-969a-b307f4e5a1cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:27.877671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=100 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:27.881256 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b9495195-fbc0-466c-969a-b307f4e5a1cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:27.882553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b9495195-fbc0-466c-969a-b307f4e5a1cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:27.883712 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b9495195-fbc0-466c-969a-b307f4e5a1cf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.159183 Jul 26 16:43:27.884316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 498/1008] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:27 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:28.402065 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4d4ee685-aa46-4269-955c-58f2db7ae6c7 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:28.402674 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4d4ee685-aa46-4269-955c-58f2db7ae6c7 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:28.410175 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d4ee685-aa46-4269-955c-58f2db7ae6c7 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:28.410626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d4ee685-aa46-4269-955c-58f2db7ae6c7 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:28.411390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d4ee685-aa46-4269-955c-58f2db7ae6c7 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:28.411830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d4ee685-aa46-4269-955c-58f2db7ae6c7 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:28.549848 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4d4ee685-aa46-4269-955c-58f2db7ae6c7 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:28.557284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4d4ee685-aa46-4269-955c-58f2db7ae6c7 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.159437 Jul 26 16:43:28.561850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 511/1009] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:28 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:28.907004 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ab3058b6-98c9-4be3-952d-1d0b27d2a886 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:28.907612 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ab3058b6-98c9-4be3-952d-1d0b27d2a886 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:28.914267 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ab3058b6-98c9-4be3-952d-1d0b27d2a886 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:28.914710 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ab3058b6-98c9-4be3-952d-1d0b27d2a886 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:28.915493 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ab3058b6-98c9-4be3-952d-1d0b27d2a886 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:28.915924 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ab3058b6-98c9-4be3-952d-1d0b27d2a886 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:29.044867 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ab3058b6-98c9-4be3-952d-1d0b27d2a886 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:29.052713 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ab3058b6-98c9-4be3-952d-1d0b27d2a886 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:29.054230 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ab3058b6-98c9-4be3-952d-1d0b27d2a886 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:29.055380 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ab3058b6-98c9-4be3-952d-1d0b27d2a886 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.152721 Jul 26 16:43:29.055928 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 499/1010] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:28 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:29.580110 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9bb4e4cb-a6c0-4cdf-8aa1-e9908a2318ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:29.580745 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9bb4e4cb-a6c0-4cdf-8aa1-e9908a2318ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:29.587347 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9bb4e4cb-a6c0-4cdf-8aa1-e9908a2318ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:29.587790 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9bb4e4cb-a6c0-4cdf-8aa1-e9908a2318ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:29.588620 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9bb4e4cb-a6c0-4cdf-8aa1-e9908a2318ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:29.589056 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9bb4e4cb-a6c0-4cdf-8aa1-e9908a2318ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:29.718492 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9bb4e4cb-a6c0-4cdf-8aa1-e9908a2318ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:29.726501 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9bb4e4cb-a6c0-4cdf-8aa1-e9908a2318ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.150349 Jul 26 16:43:29.727062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 512/1011] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:29 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:30.079478 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ad6d5259-bbc5-44c8-a9b2-28f2a30425e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:30.080106 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ad6d5259-bbc5-44c8-a9b2-28f2a30425e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:30.082353 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=60 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:30.087143 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ad6d5259-bbc5-44c8-a9b2-28f2a30425e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:30.087598 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ad6d5259-bbc5-44c8-a9b2-28f2a30425e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:30.088361 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ad6d5259-bbc5-44c8-a9b2-28f2a30425e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:30.088928 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ad6d5259-bbc5-44c8-a9b2-28f2a30425e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:30.214220 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ad6d5259-bbc5-44c8-a9b2-28f2a30425e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:30.222244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ad6d5259-bbc5-44c8-a9b2-28f2a30425e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:30.223686 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ad6d5259-bbc5-44c8-a9b2-28f2a30425e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:30.224869 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ad6d5259-bbc5-44c8-a9b2-28f2a30425e2 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.149862 Jul 26 16:43:30.225420 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 500/1012] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:30 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:43:30.746288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-60d12cd5-0485-403b-8a6d-2bcab9aba254 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:30.746894 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-60d12cd5-0485-403b-8a6d-2bcab9aba254 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:30.754240 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-60d12cd5-0485-403b-8a6d-2bcab9aba254 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:30.754625 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-60d12cd5-0485-403b-8a6d-2bcab9aba254 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:30.755378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-60d12cd5-0485-403b-8a6d-2bcab9aba254 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:30.755806 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-60d12cd5-0485-403b-8a6d-2bcab9aba254 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:30.898822 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-60d12cd5-0485-403b-8a6d-2bcab9aba254 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:30.906159 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-60d12cd5-0485-403b-8a6d-2bcab9aba254 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.163774 Jul 26 16:43:30.907240 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 513/1013] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:30 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:31.247395 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ae5b8cbf-d4e9-4406-9e36-f6b56f27a067 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:31.248009 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ae5b8cbf-d4e9-4406-9e36-f6b56f27a067 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:31.254381 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae5b8cbf-d4e9-4406-9e36-f6b56f27a067 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:31.254835 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae5b8cbf-d4e9-4406-9e36-f6b56f27a067 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:31.255602 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae5b8cbf-d4e9-4406-9e36-f6b56f27a067 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:31.256051 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae5b8cbf-d4e9-4406-9e36-f6b56f27a067 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:31.387676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ae5b8cbf-d4e9-4406-9e36-f6b56f27a067 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:31.396220 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ae5b8cbf-d4e9-4406-9e36-f6b56f27a067 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:31.397770 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ae5b8cbf-d4e9-4406-9e36-f6b56f27a067 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:31.398929 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ae5b8cbf-d4e9-4406-9e36-f6b56f27a067 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.155856 Jul 26 16:43:31.399491 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 501/1014] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:31 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:31.928324 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-77245ca2-d366-414e-b2af-84321818a6fe tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:31.928951 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-77245ca2-d366-414e-b2af-84321818a6fe tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:31.935451 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-77245ca2-d366-414e-b2af-84321818a6fe tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:31.935897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-77245ca2-d366-414e-b2af-84321818a6fe tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:31.936685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-77245ca2-d366-414e-b2af-84321818a6fe tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:31.937111 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-77245ca2-d366-414e-b2af-84321818a6fe tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:32.067053 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-77245ca2-d366-414e-b2af-84321818a6fe tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:32.074368 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-77245ca2-d366-414e-b2af-84321818a6fe tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.149969 Jul 26 16:43:32.074917 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 514/1015] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:31 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:32.422477 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b0a690d0-bd48-4c72-be01-c7f535d3476c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:32.423122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b0a690d0-bd48-4c72-be01-c7f535d3476c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:32.429719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b0a690d0-bd48-4c72-be01-c7f535d3476c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:32.430171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b0a690d0-bd48-4c72-be01-c7f535d3476c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:32.430933 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b0a690d0-bd48-4c72-be01-c7f535d3476c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:32.431371 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b0a690d0-bd48-4c72-be01-c7f535d3476c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:32.561146 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b0a690d0-bd48-4c72-be01-c7f535d3476c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:32.569585 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b0a690d0-bd48-4c72-be01-c7f535d3476c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:32.571108 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b0a690d0-bd48-4c72-be01-c7f535d3476c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:32.572270 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b0a690d0-bd48-4c72-be01-c7f535d3476c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.153671 Jul 26 16:43:32.572855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 502/1016] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:32 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:33.095357 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cc1584a9-bd12-47b6-8240-80788aeafa6f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:33.095961 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-cc1584a9-bd12-47b6-8240-80788aeafa6f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:33.098330 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=58 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:33.103058 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cc1584a9-bd12-47b6-8240-80788aeafa6f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:33.103502 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cc1584a9-bd12-47b6-8240-80788aeafa6f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:33.104257 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cc1584a9-bd12-47b6-8240-80788aeafa6f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:33.104713 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cc1584a9-bd12-47b6-8240-80788aeafa6f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:33.240600 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-cc1584a9-bd12-47b6-8240-80788aeafa6f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:33.247988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-cc1584a9-bd12-47b6-8240-80788aeafa6f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.156926 Jul 26 16:43:33.248577 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 515/1017] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:33 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:33.596014 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3636b1fe-9dae-4af9-97f2-6b4799c4ed64 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:33.596649 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3636b1fe-9dae-4af9-97f2-6b4799c4ed64 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:33.603064 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3636b1fe-9dae-4af9-97f2-6b4799c4ed64 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:33.603513 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3636b1fe-9dae-4af9-97f2-6b4799c4ed64 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:33.604272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3636b1fe-9dae-4af9-97f2-6b4799c4ed64 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:33.604730 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3636b1fe-9dae-4af9-97f2-6b4799c4ed64 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:33.731665 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3636b1fe-9dae-4af9-97f2-6b4799c4ed64 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:33.739477 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3636b1fe-9dae-4af9-97f2-6b4799c4ed64 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:33.741012 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3636b1fe-9dae-4af9-97f2-6b4799c4ed64 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:33.742161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3636b1fe-9dae-4af9-97f2-6b4799c4ed64 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.150604 Jul 26 16:43:33.742718 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 503/1018] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:33 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:34.268816 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4e63d8d9-c8d7-4f19-b406-6a0c3903505c tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:34.269417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4e63d8d9-c8d7-4f19-b406-6a0c3903505c tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:34.275990 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4e63d8d9-c8d7-4f19-b406-6a0c3903505c tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:34.276755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4e63d8d9-c8d7-4f19-b406-6a0c3903505c tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:34.277514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4e63d8d9-c8d7-4f19-b406-6a0c3903505c tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:34.277947 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4e63d8d9-c8d7-4f19-b406-6a0c3903505c tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:34.408728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4e63d8d9-c8d7-4f19-b406-6a0c3903505c tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:34.416118 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4e63d8d9-c8d7-4f19-b406-6a0c3903505c tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.151313 Jul 26 16:43:34.416703 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 516/1019] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:34 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:34.765304 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b63807dc-1db3-4c37-83e2-304f6b8aa0f5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:34.765941 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b63807dc-1db3-4c37-83e2-304f6b8aa0f5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:34.772348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b63807dc-1db3-4c37-83e2-304f6b8aa0f5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:34.772832 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b63807dc-1db3-4c37-83e2-304f6b8aa0f5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:34.773589 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b63807dc-1db3-4c37-83e2-304f6b8aa0f5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:34.774023 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b63807dc-1db3-4c37-83e2-304f6b8aa0f5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:34.911326 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b63807dc-1db3-4c37-83e2-304f6b8aa0f5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:34.919191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b63807dc-1db3-4c37-83e2-304f6b8aa0f5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:34.920741 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b63807dc-1db3-4c37-83e2-304f6b8aa0f5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:34.921928 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b63807dc-1db3-4c37-83e2-304f6b8aa0f5 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.160558 Jul 26 16:43:34.922483 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 504/1020] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:34 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:35.437158 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b00ddd39-df15-4a21-88bf-866a34dad28f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:35.438251 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b00ddd39-df15-4a21-88bf-866a34dad28f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:35.444734 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b00ddd39-df15-4a21-88bf-866a34dad28f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:35.445186 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b00ddd39-df15-4a21-88bf-866a34dad28f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:35.445938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b00ddd39-df15-4a21-88bf-866a34dad28f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:35.446372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b00ddd39-df15-4a21-88bf-866a34dad28f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:35.576539 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b00ddd39-df15-4a21-88bf-866a34dad28f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:35.584551 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b00ddd39-df15-4a21-88bf-866a34dad28f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.151206 Jul 26 16:43:35.596694 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 517/1021] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:35 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:35.945266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c49e4824-db91-4140-8171-b00baef79055 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:35.945875 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c49e4824-db91-4140-8171-b00baef79055 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:35.952311 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c49e4824-db91-4140-8171-b00baef79055 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:35.952793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c49e4824-db91-4140-8171-b00baef79055 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:35.953553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c49e4824-db91-4140-8171-b00baef79055 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:35.953993 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c49e4824-db91-4140-8171-b00baef79055 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:36.079579 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c49e4824-db91-4140-8171-b00baef79055 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:36.087372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c49e4824-db91-4140-8171-b00baef79055 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:36.088911 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c49e4824-db91-4140-8171-b00baef79055 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:36.090058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c49e4824-db91-4140-8171-b00baef79055 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.149395 Jul 26 16:43:36.090602 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 505/1022] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:35 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:36.605121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4d484d25-c235-45d3-86bf-215298816958 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:36.605819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4d484d25-c235-45d3-86bf-215298816958 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:36.612372 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d484d25-c235-45d3-86bf-215298816958 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:36.612844 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d484d25-c235-45d3-86bf-215298816958 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:36.613603 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d484d25-c235-45d3-86bf-215298816958 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:36.614034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4d484d25-c235-45d3-86bf-215298816958 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:36.747857 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4d484d25-c235-45d3-86bf-215298816958 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:36.756270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4d484d25-c235-45d3-86bf-215298816958 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.154990 Jul 26 16:43:36.756855 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 518/1023] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:36 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:37.113570 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-928fa2ec-ef65-416b-b1b1-b560789a155c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:37.114179 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-928fa2ec-ef65-416b-b1b1-b560789a155c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:37.120671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-928fa2ec-ef65-416b-b1b1-b560789a155c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:37.121120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-928fa2ec-ef65-416b-b1b1-b560789a155c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:37.121868 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-928fa2ec-ef65-416b-b1b1-b560789a155c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:37.122297 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-928fa2ec-ef65-416b-b1b1-b560789a155c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:37.253575 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-928fa2ec-ef65-416b-b1b1-b560789a155c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:37.261645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-928fa2ec-ef65-416b-b1b1-b560789a155c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:37.263245 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-928fa2ec-ef65-416b-b1b1-b560789a155c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:37.264417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-928fa2ec-ef65-416b-b1b1-b560789a155c tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.155272 Jul 26 16:43:37.264961 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 506/1024] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:37 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:37.777276 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-24211a9e-12bf-4e95-9e64-d934e3a9bb9e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:37.777895 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-24211a9e-12bf-4e95-9e64-d934e3a9bb9e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:37.786149 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-24211a9e-12bf-4e95-9e64-d934e3a9bb9e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:37.786606 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-24211a9e-12bf-4e95-9e64-d934e3a9bb9e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:37.787393 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-24211a9e-12bf-4e95-9e64-d934e3a9bb9e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:37.787830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-24211a9e-12bf-4e95-9e64-d934e3a9bb9e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:37.935698 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-24211a9e-12bf-4e95-9e64-d934e3a9bb9e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:37.946504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-24211a9e-12bf-4e95-9e64-d934e3a9bb9e tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.173000 Jul 26 16:43:37.947365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 519/1025] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:37 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:38.287264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-688a80af-5f5e-419a-a206-336dddec112a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:38.287873 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-688a80af-5f5e-419a-a206-336dddec112a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:38.294319 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-688a80af-5f5e-419a-a206-336dddec112a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:38.294767 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-688a80af-5f5e-419a-a206-336dddec112a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:38.295526 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-688a80af-5f5e-419a-a206-336dddec112a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:38.295989 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-688a80af-5f5e-419a-a206-336dddec112a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:38.424309 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-688a80af-5f5e-419a-a206-336dddec112a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:38.432233 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-688a80af-5f5e-419a-a206-336dddec112a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:38.433744 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-688a80af-5f5e-419a-a206-336dddec112a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:38.434924 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-688a80af-5f5e-419a-a206-336dddec112a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.151820 Jul 26 16:43:38.435480 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 507/1026] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:38 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 26 16:43:38.968104 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c6704f3e-e549-4232-bae2-42bd5cc17361 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:38.968755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c6704f3e-e549-4232-bae2-42bd5cc17361 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:38.975978 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c6704f3e-e549-4232-bae2-42bd5cc17361 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:38.976466 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c6704f3e-e549-4232-bae2-42bd5cc17361 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:38.977357 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c6704f3e-e549-4232-bae2-42bd5cc17361 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:38.977742 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c6704f3e-e549-4232-bae2-42bd5cc17361 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:39.112048 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c6704f3e-e549-4232-bae2-42bd5cc17361 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:39.119784 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c6704f3e-e549-4232-bae2-42bd5cc17361 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.155483 Jul 26 16:43:39.120418 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 520/1027] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:38 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:39.458584 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7d17697d-ebcb-471c-bc79-d6c18e277f43 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:39.459205 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7d17697d-ebcb-471c-bc79-d6c18e277f43 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:39.465636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d17697d-ebcb-471c-bc79-d6c18e277f43 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:39.466092 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d17697d-ebcb-471c-bc79-d6c18e277f43 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:39.466862 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d17697d-ebcb-471c-bc79-d6c18e277f43 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:39.467301 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d17697d-ebcb-471c-bc79-d6c18e277f43 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:39.602030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7d17697d-ebcb-471c-bc79-d6c18e277f43 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:39.609963 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7d17697d-ebcb-471c-bc79-d6c18e277f43 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:39.611994 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7d17697d-ebcb-471c-bc79-d6c18e277f43 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:39.613173 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7d17697d-ebcb-471c-bc79-d6c18e277f43 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.158989 Jul 26 16:43:39.613736 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 508/1028] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:39 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:40.022449 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-48356f5e-d481-49db-859e-839b56ca90be tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:40.022976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-48356f5e-d481-49db-859e-839b56ca90be tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:40.030020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48356f5e-d481-49db-859e-839b56ca90be tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:40.030458 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48356f5e-d481-49db-859e-839b56ca90be tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:40.031218 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48356f5e-d481-49db-859e-839b56ca90be tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:40.031646 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-48356f5e-d481-49db-859e-839b56ca90be tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:40.073814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-3c5356e9-ad7a-4c01-9e4b-96355d1662e8 req-9afa0348-7650-41b3-b738-48a11113482c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959309a9-7e80-4fa3-a819-5c64c66861e5", "name": "network-vif-plugged", "status": "completed", "tag": "5e531cc9-c347-49e5-b738-d36aac7e7939"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:43:40.084563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-3c5356e9-ad7a-4c01-9e4b-96355d1662e8 req-9afa0348-7650-41b3-b738-48a11113482c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:40.085006 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-3c5356e9-ad7a-4c01-9e4b-96355d1662e8 req-9afa0348-7650-41b3-b738-48a11113482c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:40.096565 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-3c5356e9-ad7a-4c01-9e4b-96355d1662e8 req-9afa0348-7650-41b3-b738-48a11113482c service nova] Creating event network-vif-plugged:5e531cc9-c347-49e5-b738-d36aac7e7939 for instance 959309a9-7e80-4fa3-a819-5c64c66861e5 on hv-cinder-85104 Jul 26 16:43:40.101674 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-3c5356e9-ad7a-4c01-9e4b-96355d1662e8 req-9afa0348-7650-41b3-b738-48a11113482c service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 Jul 26 16:43:40.102427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 509/1029] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:43:40.134567 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-48356f5e-d481-49db-859e-839b56ca90be tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lazy-loading 'services' on Instance uuid ee309e14-b43f-4f0f-98dc-ce5222fb9140 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:43:40.141732 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6e975805-c020-4984-8236-13f2166aec81 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:40.142555 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6e975805-c020-4984-8236-13f2166aec81 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:40.149336 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6e975805-c020-4984-8236-13f2166aec81 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:40.149859 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6e975805-c020-4984-8236-13f2166aec81 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:40.150631 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6e975805-c020-4984-8236-13f2166aec81 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:40.151069 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6e975805-c020-4984-8236-13f2166aec81 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:40.289868 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6e975805-c020-4984-8236-13f2166aec81 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:40.297332 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6e975805-c020-4984-8236-13f2166aec81 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.160665 Jul 26 16:43:40.297884 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 510/1030] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:40 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:43:40.522004 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-48356f5e-d481-49db-859e-839b56ca90be tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "DELETE /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140/os-volume_attachments/27904b65-4a4a-4cbf-a23d-d72fd24aa8bc" status: 202 len: 0 microversion: 2.1 time: 0.503512 Jul 26 16:43:40.523715 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 521/1031] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:43:40 2022] DELETE /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140/os-volume_attachments/27904b65-4a4a-4cbf-a23d-d72fd24aa8bc => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:43:40.636152 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fa62f7ed-de4c-4bb4-acd9-139904afd9eb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:40.636786 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fa62f7ed-de4c-4bb4-acd9-139904afd9eb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:40.642995 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa62f7ed-de4c-4bb4-acd9-139904afd9eb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:40.643909 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa62f7ed-de4c-4bb4-acd9-139904afd9eb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:40.644229 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa62f7ed-de4c-4bb4-acd9-139904afd9eb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:40.644688 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa62f7ed-de4c-4bb4-acd9-139904afd9eb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:40.809825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fa62f7ed-de4c-4bb4-acd9-139904afd9eb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:40.818450 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fa62f7ed-de4c-4bb4-acd9-139904afd9eb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:40.819973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fa62f7ed-de4c-4bb4-acd9-139904afd9eb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:40.821156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fa62f7ed-de4c-4bb4-acd9-139904afd9eb tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.188885 Jul 26 16:43:40.821732 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 511/1032] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:40 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:41.320425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-daf443b9-47ec-4798-9f13-e1dd1772ffae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:41.321046 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-daf443b9-47ec-4798-9f13-e1dd1772ffae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:41.327215 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-daf443b9-47ec-4798-9f13-e1dd1772ffae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:41.327668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-daf443b9-47ec-4798-9f13-e1dd1772ffae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:41.328464 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-daf443b9-47ec-4798-9f13-e1dd1772ffae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:41.328925 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-daf443b9-47ec-4798-9f13-e1dd1772ffae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:41.463373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-daf443b9-47ec-4798-9f13-e1dd1772ffae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:41.471047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-daf443b9-47ec-4798-9f13-e1dd1772ffae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.156056 Jul 26 16:43:41.471610 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 522/1033] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:41 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:41.844369 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2d19d5fa-12b4-48c9-8484-9541558f671f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:41.845091 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2d19d5fa-12b4-48c9-8484-9541558f671f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:41.851731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d19d5fa-12b4-48c9-8484-9541558f671f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:41.856676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d19d5fa-12b4-48c9-8484-9541558f671f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:41.856676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d19d5fa-12b4-48c9-8484-9541558f671f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:41.856676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2d19d5fa-12b4-48c9-8484-9541558f671f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:42.008748 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2d19d5fa-12b4-48c9-8484-9541558f671f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:42.017215 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2d19d5fa-12b4-48c9-8484-9541558f671f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:42.020120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2d19d5fa-12b4-48c9-8484-9541558f671f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:42.020120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2d19d5fa-12b4-48c9-8484-9541558f671f tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.179638 Jul 26 16:43:42.020826 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 512/1034] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:41 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:42.492059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6f30b295-f37b-482b-91fd-1a70784e1ee1 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:42.493510 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6f30b295-f37b-482b-91fd-1a70784e1ee1 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:42.502163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f30b295-f37b-482b-91fd-1a70784e1ee1 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:42.502663 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f30b295-f37b-482b-91fd-1a70784e1ee1 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:42.503434 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f30b295-f37b-482b-91fd-1a70784e1ee1 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:42.503919 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6f30b295-f37b-482b-91fd-1a70784e1ee1 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:42.708959 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6f30b295-f37b-482b-91fd-1a70784e1ee1 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:42.712011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6f30b295-f37b-482b-91fd-1a70784e1ee1 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.224387 Jul 26 16:43:42.720678 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 523/1035] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:42 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:43:43.049655 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-aebc208a-5e58-406a-8dd0-7ef7448ec110 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:43.051494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-aebc208a-5e58-406a-8dd0-7ef7448ec110 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:43.058228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aebc208a-5e58-406a-8dd0-7ef7448ec110 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:43.058774 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aebc208a-5e58-406a-8dd0-7ef7448ec110 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:43.059645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aebc208a-5e58-406a-8dd0-7ef7448ec110 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:43.060294 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-aebc208a-5e58-406a-8dd0-7ef7448ec110 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:43.192957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-aebc208a-5e58-406a-8dd0-7ef7448ec110 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:43.201353 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-aebc208a-5e58-406a-8dd0-7ef7448ec110 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:43.204221 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-aebc208a-5e58-406a-8dd0-7ef7448ec110 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:43.205648 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-aebc208a-5e58-406a-8dd0-7ef7448ec110 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.159789 Jul 26 16:43:43.206210 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 513/1036] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:43 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:43.733959 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5dffd75c-9c0c-4b11-a6ce-9c5fe24ce86a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:43.735151 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5dffd75c-9c0c-4b11-a6ce-9c5fe24ce86a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:43.742291 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5dffd75c-9c0c-4b11-a6ce-9c5fe24ce86a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:43.742823 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5dffd75c-9c0c-4b11-a6ce-9c5fe24ce86a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:43.743694 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5dffd75c-9c0c-4b11-a6ce-9c5fe24ce86a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:43.744252 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5dffd75c-9c0c-4b11-a6ce-9c5fe24ce86a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:43.779350 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-63075c9c-d4d6-4dbf-a450-aec55262d9c8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:43.779856 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-63075c9c-d4d6-4dbf-a450-aec55262d9c8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:43.788339 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-63075c9c-d4d6-4dbf-a450-aec55262d9c8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:43.788823 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-63075c9c-d4d6-4dbf-a450-aec55262d9c8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:43.789604 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-63075c9c-d4d6-4dbf-a450-aec55262d9c8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:43.790130 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-63075c9c-d4d6-4dbf-a450-aec55262d9c8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:43.815777 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-63075c9c-d4d6-4dbf-a450-aec55262d9c8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:43:43.898852 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5dffd75c-9c0c-4b11-a6ce-9c5fe24ce86a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:43.906626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5dffd75c-9c0c-4b11-a6ce-9c5fe24ce86a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.176319 Jul 26 16:43:43.907406 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 524/1037] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:43 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:44.008148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:44.231380 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ab39c335-4504-4556-a12f-15091c93a965 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:44.232277 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ab39c335-4504-4556-a12f-15091c93a965 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:44.247940 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab39c335-4504-4556-a12f-15091c93a965 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:44.248485 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab39c335-4504-4556-a12f-15091c93a965 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:44.253307 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab39c335-4504-4556-a12f-15091c93a965 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:44.253307 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab39c335-4504-4556-a12f-15091c93a965 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:44.387294 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ab39c335-4504-4556-a12f-15091c93a965 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:44.395463 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ab39c335-4504-4556-a12f-15091c93a965 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:44.397011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ab39c335-4504-4556-a12f-15091c93a965 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:44.398173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ab39c335-4504-4556-a12f-15091c93a965 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.172528 Jul 26 16:43:44.398817 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 525/1038] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:44 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:44.403155 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-5e2b7fa6-289b-402e-81ed-97f193aec1a8 req-56b42eb6-50b0-4447-912f-ad6e0b24510d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608fc7e4-4ccf-4823-82af-392b80004b29", "name": "network-vif-plugged", "status": "completed", "tag": "e4318fe5-e428-4abb-b479-2d426846b89d"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:43:44.410534 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-63075c9c-d4d6-4dbf-a450-aec55262d9c8 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "DELETE /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 204 len: 0 microversion: 2.1 time: 0.632924 Jul 26 16:43:44.412117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 514/1039] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:43:43 2022] DELETE /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:43:44.416366 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-5e2b7fa6-289b-402e-81ed-97f193aec1a8 req-56b42eb6-50b0-4447-912f-ad6e0b24510d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:44.416846 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-5e2b7fa6-289b-402e-81ed-97f193aec1a8 req-56b42eb6-50b0-4447-912f-ad6e0b24510d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:44.420476 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-21059e07-5433-4556-ae75-053778609228 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:44.421280 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-21059e07-5433-4556-ae75-053778609228 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:44.427749 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-21059e07-5433-4556-ae75-053778609228 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:44.428196 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-21059e07-5433-4556-ae75-053778609228 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:44.428872 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-5e2b7fa6-289b-402e-81ed-97f193aec1a8 req-56b42eb6-50b0-4447-912f-ad6e0b24510d service nova] Creating event network-vif-plugged:e4318fe5-e428-4abb-b479-2d426846b89d for instance 608fc7e4-4ccf-4823-82af-392b80004b29 on hv-cinder-85104 Jul 26 16:43:44.429015 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-21059e07-5433-4556-ae75-053778609228 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:44.429448 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-21059e07-5433-4556-ae75-053778609228 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:44.433669 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-5e2b7fa6-289b-402e-81ed-97f193aec1a8 req-56b42eb6-50b0-4447-912f-ad6e0b24510d service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033754 Jul 26 16:43:44.434254 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 526/1040] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:43:44.610488 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-21059e07-5433-4556-ae75-053778609228 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:44.618213 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-21059e07-5433-4556-ae75-053778609228 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1518 microversion: 2.1 time: 0.201805 Jul 26 16:43:44.618780 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 515/1041] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:44 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:43:44.928125 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dbcbcef2-1a05-484b-a734-b00161f54ab5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:44.928858 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dbcbcef2-1a05-484b-a734-b00161f54ab5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:44.935033 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dbcbcef2-1a05-484b-a734-b00161f54ab5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:44.935506 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dbcbcef2-1a05-484b-a734-b00161f54ab5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:44.936258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dbcbcef2-1a05-484b-a734-b00161f54ab5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:44.936721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dbcbcef2-1a05-484b-a734-b00161f54ab5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:44.956106 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:43:45.078722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-dbcbcef2-1a05-484b-a734-b00161f54ab5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:45.086988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dbcbcef2-1a05-484b-a734-b00161f54ab5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.163540 Jul 26 16:43:45.087558 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 527/1042] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:44 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:45.422296 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0bb6f274-b5f5-41d4-8887-789b505b59d9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:45.422907 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0bb6f274-b5f5-41d4-8887-789b505b59d9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:45.429932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0bb6f274-b5f5-41d4-8887-789b505b59d9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:45.430388 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0bb6f274-b5f5-41d4-8887-789b505b59d9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:45.431189 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0bb6f274-b5f5-41d4-8887-789b505b59d9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:45.431627 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0bb6f274-b5f5-41d4-8887-789b505b59d9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:45.565134 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0bb6f274-b5f5-41d4-8887-789b505b59d9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:45.573113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0bb6f274-b5f5-41d4-8887-789b505b59d9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:45.574665 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0bb6f274-b5f5-41d4-8887-789b505b59d9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:45.575813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0bb6f274-b5f5-41d4-8887-789b505b59d9 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1734 microversion: 2.20 time: 0.157474 Jul 26 16:43:45.576364 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 516/1043] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:45 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:45.638887 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f0d51a48-46ff-4849-bc41-6dc55e6f8ad9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:45.639485 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f0d51a48-46ff-4849-bc41-6dc55e6f8ad9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:45.646596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0d51a48-46ff-4849-bc41-6dc55e6f8ad9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:45.647042 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0d51a48-46ff-4849-bc41-6dc55e6f8ad9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:45.647793 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0d51a48-46ff-4849-bc41-6dc55e6f8ad9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:45.648302 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f0d51a48-46ff-4849-bc41-6dc55e6f8ad9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:45.775441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f0d51a48-46ff-4849-bc41-6dc55e6f8ad9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:45.782770 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f0d51a48-46ff-4849-bc41-6dc55e6f8ad9 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1518 microversion: 2.1 time: 0.147688 Jul 26 16:43:45.783601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 528/1044] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:45 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1518 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:43:46.107208 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7e6946cc-23cf-43a8-80cb-a724cd64dd92 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:46.107741 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7e6946cc-23cf-43a8-80cb-a724cd64dd92 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:46.113863 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e6946cc-23cf-43a8-80cb-a724cd64dd92 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:46.114319 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e6946cc-23cf-43a8-80cb-a724cd64dd92 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:46.115178 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e6946cc-23cf-43a8-80cb-a724cd64dd92 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:46.115599 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e6946cc-23cf-43a8-80cb-a724cd64dd92 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:46.258150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7e6946cc-23cf-43a8-80cb-a724cd64dd92 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:46.266420 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7e6946cc-23cf-43a8-80cb-a724cd64dd92 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.163001 Jul 26 16:43:46.268678 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 517/1045] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:46 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:46.599100 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6d835c58-aad7-42cc-88be-c635877935af tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:46.599836 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6d835c58-aad7-42cc-88be-c635877935af tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:46.607373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6d835c58-aad7-42cc-88be-c635877935af tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:46.608127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6d835c58-aad7-42cc-88be-c635877935af tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:46.608972 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6d835c58-aad7-42cc-88be-c635877935af tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:46.609407 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6d835c58-aad7-42cc-88be-c635877935af tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:46.780216 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6d835c58-aad7-42cc-88be-c635877935af tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:46.789619 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6d835c58-aad7-42cc-88be-c635877935af tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:46.791135 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6d835c58-aad7-42cc-88be-c635877935af tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:46.792470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6d835c58-aad7-42cc-88be-c635877935af tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1721 microversion: 2.20 time: 0.197430 Jul 26 16:43:46.793023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 529/1046] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:43:46 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:43:46.805202 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4d79a4e2-c701-41fb-bb2c-e69b9dd0e311 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:46.806689 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4d79a4e2-c701-41fb-bb2c-e69b9dd0e311 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:46.813717 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4d79a4e2-c701-41fb-bb2c-e69b9dd0e311 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:46.814258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4d79a4e2-c701-41fb-bb2c-e69b9dd0e311 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:46.815121 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4d79a4e2-c701-41fb-bb2c-e69b9dd0e311 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:46.815624 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4d79a4e2-c701-41fb-bb2c-e69b9dd0e311 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:47.034272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4d79a4e2-c701-41fb-bb2c-e69b9dd0e311 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:47.034272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4d79a4e2-c701-41fb-bb2c-e69b9dd0e311 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1518 microversion: 2.1 time: 0.233532 Jul 26 16:43:47.034854 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 518/1047] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:46 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1518 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:47.288365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4960ae47-319e-4a20-95ec-b7c7ae038823 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:47.288993 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4960ae47-319e-4a20-95ec-b7c7ae038823 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:47.295143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4960ae47-319e-4a20-95ec-b7c7ae038823 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:47.295596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4960ae47-319e-4a20-95ec-b7c7ae038823 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:47.296416 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4960ae47-319e-4a20-95ec-b7c7ae038823 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:47.296847 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4960ae47-319e-4a20-95ec-b7c7ae038823 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:47.450291 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-4960ae47-319e-4a20-95ec-b7c7ae038823 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:47.460799 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4960ae47-319e-4a20-95ec-b7c7ae038823 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.176988 Jul 26 16:43:47.461546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 530/1048] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:47 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:47.502230 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-62cc58e2-f9b2-4e99-8910-ae8a159dbf1c req-eba3f7f6-c924-499d-8b4b-ca5bf68e1f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee309e14-b43f-4f0f-98dc-ce5222fb9140", "name": "network-vif-deleted", "tag": "4bed39fa-7b38-4cfd-8ad4-4d313219fd2b"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:43:47.511439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-62cc58e2-f9b2-4e99-8910-ae8a159dbf1c req-eba3f7f6-c924-499d-8b4b-ca5bf68e1f7c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:47.511886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-62cc58e2-f9b2-4e99-8910-ae8a159dbf1c req-eba3f7f6-c924-499d-8b4b-ca5bf68e1f7c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:47.523353 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-62cc58e2-f9b2-4e99-8910-ae8a159dbf1c req-eba3f7f6-c924-499d-8b4b-ca5bf68e1f7c service nova] Creating event network-vif-deleted:4bed39fa-7b38-4cfd-8ad4-4d313219fd2b for instance ee309e14-b43f-4f0f-98dc-ce5222fb9140 on hv-cinder-85104 Jul 26 16:43:47.528282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-62cc58e2-f9b2-4e99-8910-ae8a159dbf1c req-eba3f7f6-c924-499d-8b4b-ca5bf68e1f7c service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163070 Jul 26 16:43:47.528906 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 519/1049] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:43:48.055142 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:48.055749 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:48.062283 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:48.062725 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:48.063497 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:48.063927 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:48.096656 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:48.097150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:48.097612 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lazy-loading 'fault' on Instance uuid ee309e14-b43f-4f0f-98dc-ce5222fb9140 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:43:48.144237 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:48.152267 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-205352cf-0653-439f-84a2-a5b00c3077af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1313 microversion: 2.1 time: 0.101090 Jul 26 16:43:48.152888 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 531/1050] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:48 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1313 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:48.483369 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ae0186f7-32de-4999-83ae-80e4070b39e8 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:48.484072 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ae0186f7-32de-4999-83ae-80e4070b39e8 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:48.491287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae0186f7-32de-4999-83ae-80e4070b39e8 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:48.491769 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae0186f7-32de-4999-83ae-80e4070b39e8 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:48.492543 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae0186f7-32de-4999-83ae-80e4070b39e8 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:48.492974 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ae0186f7-32de-4999-83ae-80e4070b39e8 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:48.630603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ae0186f7-32de-4999-83ae-80e4070b39e8 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:48.638129 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ae0186f7-32de-4999-83ae-80e4070b39e8 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1269 microversion: 2.1 time: 0.159499 Jul 26 16:43:48.638692 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 520/1051] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:48 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:49.173407 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:49.174020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:49.189233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:49.189233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:49.189233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:49.189233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:49.215784 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:49.216226 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:49.216694 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lazy-loading 'fault' on Instance uuid ee309e14-b43f-4f0f-98dc-ce5222fb9140 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:43:49.256733 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:49.264055 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a99944c0-f3f1-45ec-bd75-8317b85d217e tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 200 len: 1313 microversion: 2.1 time: 0.094517 Jul 26 16:43:49.264649 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 532/1052] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:49 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 1313 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:49.659093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-51363c62-78af-4ba8-9264-5c4c93a4b909 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:49.659717 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-51363c62-78af-4ba8-9264-5c4c93a4b909 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:49.666225 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51363c62-78af-4ba8-9264-5c4c93a4b909 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:49.666677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51363c62-78af-4ba8-9264-5c4c93a4b909 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:49.667441 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51363c62-78af-4ba8-9264-5c4c93a4b909 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:49.667880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-51363c62-78af-4ba8-9264-5c4c93a4b909 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:49.800608 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-51363c62-78af-4ba8-9264-5c4c93a4b909 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:49.808716 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-51363c62-78af-4ba8-9264-5c4c93a4b909 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1456 microversion: 2.1 time: 0.153791 Jul 26 16:43:49.809283 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 521/1053] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:49 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1456 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:49.829166 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ac4bf694-7f8c-466f-bdd6-f228952d402b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:49.829779 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ac4bf694-7f8c-466f-bdd6-f228952d402b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:49.835710 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ac4bf694-7f8c-466f-bdd6-f228952d402b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:49.836164 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ac4bf694-7f8c-466f-bdd6-f228952d402b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:49.836964 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ac4bf694-7f8c-466f-bdd6-f228952d402b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:49.837403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ac4bf694-7f8c-466f-bdd6-f228952d402b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:49.971651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ac4bf694-7f8c-466f-bdd6-f228952d402b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:43:49.979199 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ac4bf694-7f8c-466f-bdd6-f228952d402b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1456 microversion: 2.1 time: 0.153895 Jul 26 16:43:49.979760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 533/1054] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:49 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1456 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:43:50.286208 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ca2dac32-a871-4a5e-984a-f566a7848e0a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:43:50.286815 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ca2dac32-a871-4a5e-984a-f566a7848e0a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: ee309e14-b43f-4f0f-98dc-ce5222fb9140] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:43:50.292892 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ca2dac32-a871-4a5e-984a-f566a7848e0a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:50.293345 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ca2dac32-a871-4a5e-984a-f566a7848e0a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:50.294101 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ca2dac32-a871-4a5e-984a-f566a7848e0a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:50.294530 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ca2dac32-a871-4a5e-984a-f566a7848e0a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:50.310590 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-ca2dac32-a871-4a5e-984a-f566a7848e0a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] HTTP exception thrown: Instance ee309e14-b43f-4f0f-98dc-ce5222fb9140 could not be found. Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ca2dac32-a871-4a5e-984a-f566a7848e0a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Request method failure captured: Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 HTTP/1.1 Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BlPqJMj7FinvbZnzJb1PBAFf7QIn4BRFiptrA12REZIbtCzGJMf0W5_5ktQEGQJK9x7FFkK1jNMvILvO2FQiVD7tPvxD9kVoLJOdti8t6HRSVtDUO-7I-zK-wQKltN428lIZPKR21raJY5xNd8ap6lDH3T1emmXgRrX9A27_nTn7As Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: ba880373700044f08ba1adbdb416fb55 Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-VolumesSnapshotTestJSON-972542290 Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:43:50.312214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/ba880373700044f08ba1adbdb416fb55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/ba880373700044f08ba1adbdb416fb55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/ba880373700044f08ba1adbdb416fb55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_ba880373700044f08ba1adbdb416fb55", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-VolumesSnapshotTestJSON-972542290 Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: ba880373700044f08ba1adbdb416fb55 Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-972542290 Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-VolumesSnapshotTestJSON-972542290-project Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: af63552b750f4160a257596e3e0f5669 Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-VolumesSnapshotTestJSON-972542290-project Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance ee309e14-b43f-4f0f-98dc-ce5222fb9140 could not be found. Jul 26 16:43:50.314045 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': 'ee309e14-b43f-4f0f-98dc-ce5222fb9140'} Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee309e14-b43f-4f0f-98dc-ce5222fb9140 could not be found. Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:43:50.314883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee309e14-b43f-4f0f-98dc-ce5222fb9140 could not be found. Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee309e14-b43f-4f0f-98dc-ce5222fb9140 could not be found. Jul 26 16:43:50.316430 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:43:50.317726 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ca2dac32-a871-4a5e-984a-f566a7848e0a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Returning 404 to user: Instance ee309e14-b43f-4f0f-98dc-ce5222fb9140 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:43:50.317726 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ca2dac32-a871-4a5e-984a-f566a7848e0a tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140" status: 404 len: 111 microversion: 2.1 time: 0.032259 Jul 26 16:43:50.317726 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 522/1055] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:43:50 2022] GET /compute/v2.1/servers/ee309e14-b43f-4f0f-98dc-ce5222fb9140 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:43:52.874422 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-6ce57ecf-92dd-4b05-b168-1985220015f4 req-77e204c5-5bf6-4a58-9b8a-dc18f071dc77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608fc7e4-4ccf-4823-82af-392b80004b29", "tag": "e4318fe5-e428-4abb-b479-2d426846b89d"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:43:52.884685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-6ce57ecf-92dd-4b05-b168-1985220015f4 req-77e204c5-5bf6-4a58-9b8a-dc18f071dc77 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:43:52.885136 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-6ce57ecf-92dd-4b05-b168-1985220015f4 req-77e204c5-5bf6-4a58-9b8a-dc18f071dc77 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:43:52.896982 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-6ce57ecf-92dd-4b05-b168-1985220015f4 req-77e204c5-5bf6-4a58-9b8a-dc18f071dc77 service nova] Creating event network-changed:e4318fe5-e428-4abb-b479-2d426846b89d for instance 608fc7e4-4ccf-4823-82af-392b80004b29 on hv-cinder-85104 Jul 26 16:43:52.901958 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-6ce57ecf-92dd-4b05-b168-1985220015f4 req-77e204c5-5bf6-4a58-9b8a-dc18f071dc77 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031221 Jul 26 16:43:52.902548 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 534/1056] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:43:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:44:00.309694 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:00.310352 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:00.536973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f9dac4d4-dc7e-4e0c-9ffc-035eddb24335 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:00.537604 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f9dac4d4-dc7e-4e0c-9ffc-035eddb24335 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:00.543518 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9dac4d4-dc7e-4e0c-9ffc-035eddb24335 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:00.543976 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9dac4d4-dc7e-4e0c-9ffc-035eddb24335 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:00.544772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9dac4d4-dc7e-4e0c-9ffc-035eddb24335 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:00.545217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f9dac4d4-dc7e-4e0c-9ffc-035eddb24335 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:00.568569 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f9dac4d4-dc7e-4e0c-9ffc-035eddb24335 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/ips" status: 200 len: 150 microversion: 2.1 time: 0.263908 Jul 26 16:44:00.569043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 523/1057] 10.222.0.144 () {58 vars in 1253 bytes} [Tue Jul 26 16:44:00 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/ips => generated 150 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:44:03.694468 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=43 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:03.695385 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=44 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:03.699477 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1002345119", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "networks": [{"uuid": "72cf3937-9e4d-41cc-b20a-bd33e5507cd9"}]}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:44:03.754336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] validate_networks() for [('72cf3937-9e4d-41cc-b20a-bd33e5507cd9', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:44:04.195482 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:44:04.195905 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:44:04.196415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:44:04.196817 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:44:04.197226 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:44:04.206170 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:04.206820 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:04.207649 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:04.208084 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:04.225207 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Getting quotas for project ba880373700044f08ba1adbdb416fb55. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:44:04.229253 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Getting quotas for user af63552b750f4160a257596e3e0f5669 and project ba880373700044f08ba1adbdb416fb55. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:44:04.241037 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:44:04.244861 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:44:04.422844 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-646d2976-cb5f-4e2b-8294-45be2efc9b81 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.723042 Jul 26 16:44:04.422844 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 535/1058] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:44:03 2022] POST /compute/v2.1/servers => generated 382 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:44:04.427977 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ef027c00-253a-4fb7-94cd-ea0b7fda6e4f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:04.428611 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ef027c00-253a-4fb7-94cd-ea0b7fda6e4f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:04.508858 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ef027c00-253a-4fb7-94cd-ea0b7fda6e4f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:04.513422 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ef027c00-253a-4fb7-94cd-ea0b7fda6e4f tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1223 microversion: 2.1 time: 0.089822 Jul 26 16:44:04.513970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 524/1059] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:04 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:04.526492 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6ff8f639-795a-4d8b-998e-53eb3c1abe44 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90d7d7d3-29e5-4f33-ad42-cad102c338d9"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:44:04.532786 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6ff8f639-795a-4d8b-998e-53eb3c1abe44 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:04.538981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ff8f639-795a-4d8b-998e-53eb3c1abe44 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:04.539578 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ff8f639-795a-4d8b-998e-53eb3c1abe44 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:04.540357 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ff8f639-795a-4d8b-998e-53eb3c1abe44 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:04.540828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ff8f639-795a-4d8b-998e-53eb3c1abe44 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:05.533932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9469a2b1-e667-4d6b-904b-46dd8474566b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:05.534584 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9469a2b1-e667-4d6b-904b-46dd8474566b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:05.599886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9469a2b1-e667-4d6b-904b-46dd8474566b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:05.606876 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9469a2b1-e667-4d6b-904b-46dd8474566b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1223 microversion: 2.1 time: 0.077367 Jul 26 16:44:05.607437 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 525/1060] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:05 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:44:05.863129 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6ff8f639-795a-4d8b-998e-53eb3c1abe44 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "POST /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.340771 Jul 26 16:44:05.864128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 536/1061] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:44:04 2022] POST /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments => generated 194 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:44:06.627451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cbce538f-bec9-4d17-87ed-7f3aaac6445b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:06.628172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cbce538f-bec9-4d17-87ed-7f3aaac6445b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:06.635630 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbce538f-bec9-4d17-87ed-7f3aaac6445b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:06.636081 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbce538f-bec9-4d17-87ed-7f3aaac6445b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:06.636887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbce538f-bec9-4d17-87ed-7f3aaac6445b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:06.637323 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cbce538f-bec9-4d17-87ed-7f3aaac6445b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:06.701844 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cbce538f-bec9-4d17-87ed-7f3aaac6445b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:06.709496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cbce538f-bec9-4d17-87ed-7f3aaac6445b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1275 microversion: 2.1 time: 0.086233 Jul 26 16:44:06.710051 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 526/1062] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:06 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:07.731210 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c76df257-e3fb-4d9e-8668-6266f1da9cb2 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:07.731917 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c76df257-e3fb-4d9e-8668-6266f1da9cb2 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:07.739290 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c76df257-e3fb-4d9e-8668-6266f1da9cb2 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:07.739731 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c76df257-e3fb-4d9e-8668-6266f1da9cb2 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:07.740504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c76df257-e3fb-4d9e-8668-6266f1da9cb2 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:07.740934 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c76df257-e3fb-4d9e-8668-6266f1da9cb2 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:07.809588 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c76df257-e3fb-4d9e-8668-6266f1da9cb2 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:07.817615 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c76df257-e3fb-4d9e-8668-6266f1da9cb2 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1283 microversion: 2.1 time: 0.090631 Jul 26 16:44:07.818225 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 537/1063] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:07 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1283 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:08.839498 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-190778d0-a0b1-4ae2-8d6b-240638acffad tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:08.840738 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-190778d0-a0b1-4ae2-8d6b-240638acffad tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:08.847244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-190778d0-a0b1-4ae2-8d6b-240638acffad tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:08.847701 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-190778d0-a0b1-4ae2-8d6b-240638acffad tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:08.848563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-190778d0-a0b1-4ae2-8d6b-240638acffad tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:08.849526 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-190778d0-a0b1-4ae2-8d6b-240638acffad tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:09.043479 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-190778d0-a0b1-4ae2-8d6b-240638acffad tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:09.051088 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-190778d0-a0b1-4ae2-8d6b-240638acffad tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1323 microversion: 2.1 time: 0.215711 Jul 26 16:44:09.051720 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 527/1064] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:08 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1323 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:10.072467 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dfbef381-5f80-439e-85f8-34eec57625cf tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:10.073106 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dfbef381-5f80-439e-85f8-34eec57625cf tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:10.079700 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dfbef381-5f80-439e-85f8-34eec57625cf tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:10.080156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dfbef381-5f80-439e-85f8-34eec57625cf tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:10.080992 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dfbef381-5f80-439e-85f8-34eec57625cf tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:10.081455 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dfbef381-5f80-439e-85f8-34eec57625cf tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:10.153190 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-972f6086-e561-4cbf-9980-ffdff06adec7 req-d2a482c8-0ad3-426b-a4a6-72d8b3c4ff32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18cce1f8-c8c3-4494-bf6a-521dd35f147b", "tag": "1482a307-064c-4d1a-a3ee-ba917280bd28"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:44:10.169975 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-972f6086-e561-4cbf-9980-ffdff06adec7 req-d2a482c8-0ad3-426b-a4a6-72d8b3c4ff32 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:10.170426 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-972f6086-e561-4cbf-9980-ffdff06adec7 req-d2a482c8-0ad3-426b-a4a6-72d8b3c4ff32 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:10.182105 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-972f6086-e561-4cbf-9980-ffdff06adec7 req-d2a482c8-0ad3-426b-a4a6-72d8b3c4ff32 service nova] Creating event network-changed:1482a307-064c-4d1a-a3ee-ba917280bd28 for instance 18cce1f8-c8c3-4494-bf6a-521dd35f147b on hv-cinder-85104 Jul 26 16:44:10.187352 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-972f6086-e561-4cbf-9980-ffdff06adec7 req-d2a482c8-0ad3-426b-a4a6-72d8b3c4ff32 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037900 Jul 26 16:44:10.190152 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 528/1065] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:44:10.223121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-dfbef381-5f80-439e-85f8-34eec57625cf tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:10.232219 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dfbef381-5f80-439e-85f8-34eec57625cf tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1323 microversion: 2.1 time: 0.163732 Jul 26 16:44:10.232839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 538/1066] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:10 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:11.255511 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9e832415-80d2-4f6e-ad81-191e1906507b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:11.256267 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9e832415-80d2-4f6e-ad81-191e1906507b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:11.262562 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e832415-80d2-4f6e-ad81-191e1906507b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:11.263011 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e832415-80d2-4f6e-ad81-191e1906507b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:11.263764 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e832415-80d2-4f6e-ad81-191e1906507b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:11.264198 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9e832415-80d2-4f6e-ad81-191e1906507b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:11.403597 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9e832415-80d2-4f6e-ad81-191e1906507b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:11.411266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9e832415-80d2-4f6e-ad81-191e1906507b tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1323 microversion: 2.1 time: 0.160869 Jul 26 16:44:11.411825 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 529/1067] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:11 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1323 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:12.431459 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-497186db-bf70-404c-88fc-9bd98c0d9912 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:12.432067 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-497186db-bf70-404c-88fc-9bd98c0d9912 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:12.438491 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-497186db-bf70-404c-88fc-9bd98c0d9912 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:12.438940 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-497186db-bf70-404c-88fc-9bd98c0d9912 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:12.439700 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-497186db-bf70-404c-88fc-9bd98c0d9912 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:12.440131 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-497186db-bf70-404c-88fc-9bd98c0d9912 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:12.574364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-497186db-bf70-404c-88fc-9bd98c0d9912 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:12.581976 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-497186db-bf70-404c-88fc-9bd98c0d9912 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1323 microversion: 2.1 time: 0.154252 Jul 26 16:44:12.582527 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 539/1068] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:12 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1323 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:13.603059 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1314f61e-5365-49ed-8851-669b4c3370d3 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:13.603587 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1314f61e-5365-49ed-8851-669b4c3370d3 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:13.610074 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1314f61e-5365-49ed-8851-669b4c3370d3 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:13.610529 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1314f61e-5365-49ed-8851-669b4c3370d3 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:13.611293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1314f61e-5365-49ed-8851-669b4c3370d3 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:13.611729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1314f61e-5365-49ed-8851-669b4c3370d3 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:13.740352 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1314f61e-5365-49ed-8851-669b4c3370d3 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:13.747690 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1314f61e-5365-49ed-8851-669b4c3370d3 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1323 microversion: 2.1 time: 0.149112 Jul 26 16:44:13.748235 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 530/1069] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:13 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1323 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:14.771057 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0386c94b-1a55-4cc9-b729-a5bd5a3174af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:14.771608 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0386c94b-1a55-4cc9-b729-a5bd5a3174af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:14.774002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:14.774667 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=6 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:14.779582 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0386c94b-1a55-4cc9-b729-a5bd5a3174af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:14.783814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0386c94b-1a55-4cc9-b729-a5bd5a3174af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:14.783814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0386c94b-1a55-4cc9-b729-a5bd5a3174af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:14.783814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0386c94b-1a55-4cc9-b729-a5bd5a3174af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:14.915865 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0386c94b-1a55-4cc9-b729-a5bd5a3174af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:14.923403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0386c94b-1a55-4cc9-b729-a5bd5a3174af tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1323 microversion: 2.1 time: 0.156338 Jul 26 16:44:14.933446 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 540/1070] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:14 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1323 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:15.949268 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9d7d6619-5386-454b-8014-34e3805b8e36 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:15.949814 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9d7d6619-5386-454b-8014-34e3805b8e36 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:15.952507 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=4 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:15.958504 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d7d6619-5386-454b-8014-34e3805b8e36 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:15.959053 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d7d6619-5386-454b-8014-34e3805b8e36 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:15.959900 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d7d6619-5386-454b-8014-34e3805b8e36 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:15.960424 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9d7d6619-5386-454b-8014-34e3805b8e36 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:16.096310 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9d7d6619-5386-454b-8014-34e3805b8e36 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:16.103819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9d7d6619-5386-454b-8014-34e3805b8e36 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1323 microversion: 2.1 time: 0.158750 Jul 26 16:44:16.104372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 531/1071] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:15 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:17.101556 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-1bac0e9f-56c6-4705-9db7-f9a0f3c07f84 req-0095939c-b1de-4e0d-adc2-611e54ce5bc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18cce1f8-c8c3-4494-bf6a-521dd35f147b", "name": "network-vif-plugged", "status": "completed", "tag": "1482a307-064c-4d1a-a3ee-ba917280bd28"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:44:17.111138 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-1bac0e9f-56c6-4705-9db7-f9a0f3c07f84 req-0095939c-b1de-4e0d-adc2-611e54ce5bc1 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:17.111707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-1bac0e9f-56c6-4705-9db7-f9a0f3c07f84 req-0095939c-b1de-4e0d-adc2-611e54ce5bc1 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:17.126157 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-1bac0e9f-56c6-4705-9db7-f9a0f3c07f84 req-0095939c-b1de-4e0d-adc2-611e54ce5bc1 service nova] Creating event network-vif-plugged:1482a307-064c-4d1a-a3ee-ba917280bd28 for instance 18cce1f8-c8c3-4494-bf6a-521dd35f147b on hv-cinder-85104 Jul 26 16:44:17.126993 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7beb1907-14bb-4137-9bd9-55dcd3231013 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:17.128568 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7beb1907-14bb-4137-9bd9-55dcd3231013 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:17.135622 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-1bac0e9f-56c6-4705-9db7-f9a0f3c07f84 req-0095939c-b1de-4e0d-adc2-611e54ce5bc1 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177836 Jul 26 16:44:17.136792 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 541/1072] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:44:17.147013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7beb1907-14bb-4137-9bd9-55dcd3231013 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:17.147013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7beb1907-14bb-4137-9bd9-55dcd3231013 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:17.147013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7beb1907-14bb-4137-9bd9-55dcd3231013 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:17.147013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7beb1907-14bb-4137-9bd9-55dcd3231013 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:17.288314 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7beb1907-14bb-4137-9bd9-55dcd3231013 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:17.295828 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7beb1907-14bb-4137-9bd9-55dcd3231013 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1323 microversion: 2.1 time: 0.174816 Jul 26 16:44:17.296405 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 532/1073] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:17 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1323 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:17.733233 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9c3c56b5-384b-49a8-a780-701635e7296d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:17.733814 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9c3c56b5-384b-49a8-a780-701635e7296d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:17.740089 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c3c56b5-384b-49a8-a780-701635e7296d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:17.740576 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c3c56b5-384b-49a8-a780-701635e7296d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:17.741338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c3c56b5-384b-49a8-a780-701635e7296d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:17.741776 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9c3c56b5-384b-49a8-a780-701635e7296d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:17.820741 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-9c3c56b5-384b-49a8-a780-701635e7296d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lazy-loading 'services' on Instance uuid 3537f9da-57c2-4c3d-a733-98a467c4ca30 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:44:18.092811 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9c3c56b5-384b-49a8-a780-701635e7296d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments/90d7d7d3-29e5-4f33-ad42-cad102c338d9" status: 202 len: 0 microversion: 2.1 time: 0.363626 Jul 26 16:44:18.093701 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 542/1074] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:44:17 2022] DELETE /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments/90d7d7d3-29e5-4f33-ad42-cad102c338d9 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:44:18.102167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6d838145-1ec5-4431-951e-ae9e5d37936d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:18.105562 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6d838145-1ec5-4431-951e-ae9e5d37936d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:18.110560 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d838145-1ec5-4431-951e-ae9e5d37936d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:18.111013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d838145-1ec5-4431-951e-ae9e5d37936d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:18.111819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d838145-1ec5-4431-951e-ae9e5d37936d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:18.112252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6d838145-1ec5-4431-951e-ae9e5d37936d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:18.141214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6d838145-1ec5-4431-951e-ae9e5d37936d tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Jul 26 16:44:18.141816 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 533/1075] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:44:18 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:44:18.325466 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7e989e8a-1281-4234-972a-cf3e7509d681 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:18.325991 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7e989e8a-1281-4234-972a-cf3e7509d681 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:18.332302 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7e989e8a-1281-4234-972a-cf3e7509d681 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:18.332791 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7e989e8a-1281-4234-972a-cf3e7509d681 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:18.333554 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7e989e8a-1281-4234-972a-cf3e7509d681 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:18.333987 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7e989e8a-1281-4234-972a-cf3e7509d681 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:18.467451 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7e989e8a-1281-4234-972a-cf3e7509d681 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:18.475108 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7e989e8a-1281-4234-972a-cf3e7509d681 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1323 microversion: 2.1 time: 0.153916 Jul 26 16:44:18.475660 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 543/1076] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:18 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:44:19.154339 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3214ae00-ef53-403f-ab80-1bb5ae7c0c64 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:19.164219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3214ae00-ef53-403f-ab80-1bb5ae7c0c64 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:19.164219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3214ae00-ef53-403f-ab80-1bb5ae7c0c64 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:19.164462 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3214ae00-ef53-403f-ab80-1bb5ae7c0c64 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:19.165058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3214ae00-ef53-403f-ab80-1bb5ae7c0c64 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:19.165493 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3214ae00-ef53-403f-ab80-1bb5ae7c0c64 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:19.195927 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3214ae00-ef53-403f-ab80-1bb5ae7c0c64 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043571 Jul 26 16:44:19.195927 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 534/1077] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:44:19 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:44:19.495769 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7cc65322-ca26-4923-b740-3e866f676cc5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:19.496379 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7cc65322-ca26-4923-b740-3e866f676cc5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:19.502908 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cc65322-ca26-4923-b740-3e866f676cc5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:19.503358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cc65322-ca26-4923-b740-3e866f676cc5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:19.504120 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cc65322-ca26-4923-b740-3e866f676cc5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:19.504586 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7cc65322-ca26-4923-b740-3e866f676cc5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:19.638668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7cc65322-ca26-4923-b740-3e866f676cc5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:19.646109 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7cc65322-ca26-4923-b740-3e866f676cc5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1323 microversion: 2.1 time: 0.154258 Jul 26 16:44:19.646666 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 544/1078] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:19 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:20.206312 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cd46e269-6ad4-49b8-b212-8ecaacefd007 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:20.210719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cd46e269-6ad4-49b8-b212-8ecaacefd007 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:20.215494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd46e269-6ad4-49b8-b212-8ecaacefd007 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:20.216019 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd46e269-6ad4-49b8-b212-8ecaacefd007 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:20.216900 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd46e269-6ad4-49b8-b212-8ecaacefd007 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:20.217420 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd46e269-6ad4-49b8-b212-8ecaacefd007 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:20.250990 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cd46e269-6ad4-49b8-b212-8ecaacefd007 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 Jul 26 16:44:20.250990 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 535/1079] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:44:20 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:44:20.667047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b39c05ed-d9d2-45cb-89ce-dd1416c457e5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:20.667762 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b39c05ed-d9d2-45cb-89ce-dd1416c457e5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:20.674305 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b39c05ed-d9d2-45cb-89ce-dd1416c457e5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:20.679288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b39c05ed-d9d2-45cb-89ce-dd1416c457e5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:20.679288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b39c05ed-d9d2-45cb-89ce-dd1416c457e5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:20.679288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b39c05ed-d9d2-45cb-89ce-dd1416c457e5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:20.804962 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b39c05ed-d9d2-45cb-89ce-dd1416c457e5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:20.812342 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b39c05ed-d9d2-45cb-89ce-dd1416c457e5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1511 microversion: 2.1 time: 0.149204 Jul 26 16:44:20.812932 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 545/1080] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:20 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:20.833715 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-18d6032a-d047-493f-adc4-b25c867f0d60 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d20e1213-1730-4bb4-a691-56fe043acf7f", "device": "/dev/sdb"}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:44:20.836068 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-18d6032a-d047-493f-adc4-b25c867f0d60 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:20.842091 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-18d6032a-d047-493f-adc4-b25c867f0d60 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:20.842543 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-18d6032a-d047-493f-adc4-b25c867f0d60 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:20.843306 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-18d6032a-d047-493f-adc4-b25c867f0d60 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:20.843742 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-18d6032a-d047-493f-adc4-b25c867f0d60 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:21.268620 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2ce35e3d-12f5-4a44-b31d-72b460d40c5e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:21.271798 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2ce35e3d-12f5-4a44-b31d-72b460d40c5e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:21.278799 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2ce35e3d-12f5-4a44-b31d-72b460d40c5e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:21.279244 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2ce35e3d-12f5-4a44-b31d-72b460d40c5e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:21.280013 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2ce35e3d-12f5-4a44-b31d-72b460d40c5e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:21.280503 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2ce35e3d-12f5-4a44-b31d-72b460d40c5e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:21.309868 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2ce35e3d-12f5-4a44-b31d-72b460d40c5e tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050026 Jul 26 16:44:21.310416 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 546/1081] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:44:21 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 16:44:21.380417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-61603b87-9454-4209-878e-48ea4394965f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:21.381300 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-61603b87-9454-4209-878e-48ea4394965f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:21.388655 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61603b87-9454-4209-878e-48ea4394965f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:21.389102 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61603b87-9454-4209-878e-48ea4394965f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:21.389897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61603b87-9454-4209-878e-48ea4394965f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:21.390326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61603b87-9454-4209-878e-48ea4394965f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:21.416648 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-61603b87-9454-4209-878e-48ea4394965f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Going to try to terminate instance {{(pid=124821) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:44:21.892258 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-61603b87-9454-4209-878e-48ea4394965f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 204 len: 0 microversion: 2.1 time: 0.516546 Jul 26 16:44:21.892921 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 547/1082] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:44:21 2022] DELETE /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 26 16:44:21.901723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ec744a99-2852-459b-911a-a4c3fd42274a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:21.902419 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ec744a99-2852-459b-911a-a4c3fd42274a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:21.908655 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec744a99-2852-459b-911a-a4c3fd42274a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:21.909123 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec744a99-2852-459b-911a-a4c3fd42274a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:21.909886 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec744a99-2852-459b-911a-a4c3fd42274a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:21.910321 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec744a99-2852-459b-911a-a4c3fd42274a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:21.975857 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-18d6032a-d047-493f-adc4-b25c867f0d60 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "POST /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.146146 Jul 26 16:44:21.976810 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 536/1083] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:44:20 2022] POST /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b/os-volume_attachments => generated 194 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:44:22.051704 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ec744a99-2852-459b-911a-a4c3fd42274a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:22.059514 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ec744a99-2852-459b-911a-a4c3fd42274a tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1687 microversion: 2.1 time: 0.161721 Jul 26 16:44:22.060096 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 548/1084] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:21 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1687 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:44:23.083490 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-dbc1da6e-aebb-4cd0-87da-3d4849813793 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:23.084190 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-dbc1da6e-aebb-4cd0-87da-3d4849813793 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:23.090384 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dbc1da6e-aebb-4cd0-87da-3d4849813793 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:23.090838 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dbc1da6e-aebb-4cd0-87da-3d4849813793 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:23.091603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dbc1da6e-aebb-4cd0-87da-3d4849813793 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:23.092052 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dbc1da6e-aebb-4cd0-87da-3d4849813793 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:23.220457 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-dbc1da6e-aebb-4cd0-87da-3d4849813793 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:23.228280 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-dbc1da6e-aebb-4cd0-87da-3d4849813793 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1687 microversion: 2.1 time: 0.149453 Jul 26 16:44:23.228873 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 537/1085] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:23 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:24.249370 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6fe2a113-140e-43f9-b1dd-61fd347fe966 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:24.249982 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6fe2a113-140e-43f9-b1dd-61fd347fe966 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:24.257143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6fe2a113-140e-43f9-b1dd-61fd347fe966 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:24.257598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6fe2a113-140e-43f9-b1dd-61fd347fe966 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:24.258362 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6fe2a113-140e-43f9-b1dd-61fd347fe966 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:24.258800 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6fe2a113-140e-43f9-b1dd-61fd347fe966 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:24.262974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:24.388828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6fe2a113-140e-43f9-b1dd-61fd347fe966 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:24.396338 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6fe2a113-140e-43f9-b1dd-61fd347fe966 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1687 microversion: 2.1 time: 0.150846 Jul 26 16:44:24.397404 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 549/1086] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:24 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:25.418364 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c700b783-2c96-4f30-8ea1-11f5fe11dc28 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:25.418939 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c700b783-2c96-4f30-8ea1-11f5fe11dc28 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:25.425633 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c700b783-2c96-4f30-8ea1-11f5fe11dc28 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:25.426693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c700b783-2c96-4f30-8ea1-11f5fe11dc28 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:25.427460 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c700b783-2c96-4f30-8ea1-11f5fe11dc28 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:25.427897 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c700b783-2c96-4f30-8ea1-11f5fe11dc28 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:25.931287 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c700b783-2c96-4f30-8ea1-11f5fe11dc28 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:25.939506 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c700b783-2c96-4f30-8ea1-11f5fe11dc28 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1687 microversion: 2.1 time: 0.524987 Jul 26 16:44:25.940427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 538/1087] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:25 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1687 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:44:26.114197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-690369a7-6fad-43fe-934f-9b654240c24d req-3479f82f-4fed-4a80-85de-56bac44076d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3537f9da-57c2-4c3d-a733-98a467c4ca30", "name": "network-vif-deleted", "tag": "ff83ae02-6aed-4b08-a74a-deeb7a1cb522"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:44:26.130747 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-690369a7-6fad-43fe-934f-9b654240c24d req-3479f82f-4fed-4a80-85de-56bac44076d4 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:26.130747 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-690369a7-6fad-43fe-934f-9b654240c24d req-3479f82f-4fed-4a80-85de-56bac44076d4 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:26.136773 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-690369a7-6fad-43fe-934f-9b654240c24d req-3479f82f-4fed-4a80-85de-56bac44076d4 service nova] Creating event network-vif-deleted:ff83ae02-6aed-4b08-a74a-deeb7a1cb522 for instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 on hv-cinder-85104 Jul 26 16:44:26.141490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-690369a7-6fad-43fe-934f-9b654240c24d req-3479f82f-4fed-4a80-85de-56bac44076d4 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030956 Jul 26 16:44:26.142078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 550/1088] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:44:26.961380 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:26.962013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:26.968183 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:26.968663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:26.969428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:26.969865 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:27.000400 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:27.000780 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:27.001235 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.objects.instance [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lazy-loading 'fault' on Instance uuid 3537f9da-57c2-4c3d-a733-98a467c4ca30 {{(pid=124820) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:44:27.042644 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c6fffcc3c0d4c49848fa6c2f6b90130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bb1d794693b410d8c759796d5e20281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:44:27.050071 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a258d0a5-0db0-481d-8e5f-4f67e79c334c tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 200 len: 1336 microversion: 2.1 time: 0.092978 Jul 26 16:44:27.050821 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 539/1089] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:26 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 1336 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:44:27.898186 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:44:27.898496 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:44:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:44:28.078647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ce450dbb-28d2-4609-80b3-30ad8be2cdea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:28.079344 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ce450dbb-28d2-4609-80b3-30ad8be2cdea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:28.086168 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ce450dbb-28d2-4609-80b3-30ad8be2cdea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:28.086620 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ce450dbb-28d2-4609-80b3-30ad8be2cdea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:28.087400 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ce450dbb-28d2-4609-80b3-30ad8be2cdea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:28.087870 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ce450dbb-28d2-4609-80b3-30ad8be2cdea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:28.102654 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-ce450dbb-28d2-4609-80b3-30ad8be2cdea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ce450dbb-28d2-4609-80b3-30ad8be2cdea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 HTTP/1.1 Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:44:28.104728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:28.106483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '3537f9da-57c2-4c3d-a733-98a467c4ca30'} Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:44:28.107425 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:28.108979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:28.110403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ce450dbb-28d2-4609-80b3-30ad8be2cdea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:44:28.110403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ce450dbb-28d2-4609-80b3-30ad8be2cdea tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 404 len: 111 microversion: 2.1 time: 0.033310 Jul 26 16:44:28.110403 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 551/1090] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:28 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:44:28.116756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-83231a5f-1b35-45c1-a0a3-3ba4a055e06f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '.version_select at 0x7f4b6c0d7310>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:28.357178 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-83231a5f-1b35-45c1-a0a3-3ba4a055e06f tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056727071" status: 202 len: 0 microversion: 2.1 time: 0.244179 Jul 26 16:44:28.357879 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 540/1091] 10.222.0.144 () {58 vars in 1226 bytes} [Tue Jul 26 16:44:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056727071 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:44:29.614673 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:44:29.615293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:44:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:44:30.775055 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dc0ae2c6-62ef-4108-ae10-b4cb3b787d73 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:30.775553 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dc0ae2c6-62ef-4108-ae10-b4cb3b787d73 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:30.782103 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dc0ae2c6-62ef-4108-ae10-b4cb3b787d73 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:30.782547 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dc0ae2c6-62ef-4108-ae10-b4cb3b787d73 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:30.783313 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dc0ae2c6-62ef-4108-ae10-b4cb3b787d73 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:30.784019 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dc0ae2c6-62ef-4108-ae10-b4cb3b787d73 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:30.797830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-dc0ae2c6-62ef-4108-ae10-b4cb3b787d73 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dc0ae2c6-62ef-4108-ae10-b4cb3b787d73 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: DELETE /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 HTTP/1.1 Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:44:30.799423 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:30.801581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '3537f9da-57c2-4c3d-a733-98a467c4ca30'} Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:44:30.802478 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:30.803891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:30.805284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dc0ae2c6-62ef-4108-ae10-b4cb3b787d73 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:44:30.805284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dc0ae2c6-62ef-4108-ae10-b4cb3b787d73 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 404 len: 111 microversion: 2.1 time: 0.029566 Jul 26 16:44:30.805284 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 552/1092] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:44:30 2022] DELETE /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:44:30.814380 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-78fdd6b1-be96-4d35-8f1e-ddb7b86f1998 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:30.814982 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-78fdd6b1-be96-4d35-8f1e-ddb7b86f1998 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 3537f9da-57c2-4c3d-a733-98a467c4ca30] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:30.822132 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78fdd6b1-be96-4d35-8f1e-ddb7b86f1998 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:30.822578 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78fdd6b1-be96-4d35-8f1e-ddb7b86f1998 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:30.823337 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78fdd6b1-be96-4d35-8f1e-ddb7b86f1998 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:30.823772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-78fdd6b1-be96-4d35-8f1e-ddb7b86f1998 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:30.844511 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-78fdd6b1-be96-4d35-8f1e-ddb7b86f1998 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-78fdd6b1-be96-4d35-8f1e-ddb7b86f1998 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 HTTP/1.1 Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:44:30.846172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:30.848363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '3537f9da-57c2-4c3d-a733-98a467c4ca30'} Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:44:30.856102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. Jul 26 16:44:30.857677 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:30.858947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-78fdd6b1-be96-4d35-8f1e-ddb7b86f1998 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 3537f9da-57c2-4c3d-a733-98a467c4ca30 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:44:30.858947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-78fdd6b1-be96-4d35-8f1e-ddb7b86f1998 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30" status: 404 len: 111 microversion: 2.1 time: 0.037085 Jul 26 16:44:30.858947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 541/1093] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:30 2022] GET /compute/v2.1/servers/3537f9da-57c2-4c3d-a733-98a467c4ca30 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:44:32.274849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-91e91337-0316-416d-8001-12bb234b26f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:32.275383 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-91e91337-0316-416d-8001-12bb234b26f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:32.281926 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-91e91337-0316-416d-8001-12bb234b26f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:32.282371 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-91e91337-0316-416d-8001-12bb234b26f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:32.283119 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-91e91337-0316-416d-8001-12bb234b26f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:32.283815 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-91e91337-0316-416d-8001-12bb234b26f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:32.297157 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-91e91337-0316-416d-8001-12bb234b26f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-91e91337-0316-416d-8001-12bb234b26f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: DELETE /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 HTTP/1.1 Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:44:32.298671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:44:32.300272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '5c11953c-a484-4d00-a221-e03e55f46dc4'} Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:44:32.305470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:44:32.306970 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.308605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-91e91337-0316-416d-8001-12bb234b26f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:44:32.308605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-91e91337-0316-416d-8001-12bb234b26f5 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 404 len: 111 microversion: 2.1 time: 0.029025 Jul 26 16:44:32.308605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 553/1094] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:44:32 2022] DELETE /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:44:32.312721 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5355cf9a-9018-433e-89da-c0bc3212b5f8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:32.313334 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5355cf9a-9018-433e-89da-c0bc3212b5f8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 5c11953c-a484-4d00-a221-e03e55f46dc4] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:32.320303 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5355cf9a-9018-433e-89da-c0bc3212b5f8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:32.320797 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5355cf9a-9018-433e-89da-c0bc3212b5f8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:32.321557 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5355cf9a-9018-433e-89da-c0bc3212b5f8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:32.321994 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5355cf9a-9018-433e-89da-c0bc3212b5f8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:32.335440 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-5355cf9a-9018-433e-89da-c0bc3212b5f8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5355cf9a-9018-433e-89da-c0bc3212b5f8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 HTTP/1.1 Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:44:32.337156 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:44:32.338804 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '5c11953c-a484-4d00-a221-e03e55f46dc4'} Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:44:32.339672 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. Jul 26 16:44:32.341264 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.342543 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5355cf9a-9018-433e-89da-c0bc3212b5f8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 5c11953c-a484-4d00-a221-e03e55f46dc4 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:44:32.342543 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5355cf9a-9018-433e-89da-c0bc3212b5f8 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4" status: 404 len: 111 microversion: 2.1 time: 0.030213 Jul 26 16:44:32.342543 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 542/1095] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:32 2022] GET /compute/v2.1/servers/5c11953c-a484-4d00-a221-e03e55f46dc4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:44:32.346951 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-075d03e4-2cf9-49ef-93cf-095a7067f318 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:32.350646 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-075d03e4-2cf9-49ef-93cf-095a7067f318 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:32.353429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-075d03e4-2cf9-49ef-93cf-095a7067f318 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:32.353873 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-075d03e4-2cf9-49ef-93cf-095a7067f318 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:32.354624 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-075d03e4-2cf9-49ef-93cf-095a7067f318 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:32.355052 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-075d03e4-2cf9-49ef-93cf-095a7067f318 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:32.369047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-075d03e4-2cf9-49ef-93cf-095a7067f318 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-075d03e4-2cf9-49ef-93cf-095a7067f318 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: DELETE /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d HTTP/1.1 Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:44:32.370573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:44:32.372198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '178c5e10-8273-4f85-8802-ab643a1c9b6d'} Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:44:32.373156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:44:32.374718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.376218 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-075d03e4-2cf9-49ef-93cf-095a7067f318 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:44:32.376218 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-075d03e4-2cf9-49ef-93cf-095a7067f318 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 404 len: 111 microversion: 2.1 time: 0.028865 Jul 26 16:44:32.376218 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 554/1096] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:44:32 2022] DELETE /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:44:32.380790 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f8a253b5-940c-4b98-99c4-48585b8964af tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:32.381425 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f8a253b5-940c-4b98-99c4-48585b8964af tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 178c5e10-8273-4f85-8802-ab643a1c9b6d] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:32.387813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f8a253b5-940c-4b98-99c4-48585b8964af tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:32.388209 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f8a253b5-940c-4b98-99c4-48585b8964af tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:32.389013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f8a253b5-940c-4b98-99c4-48585b8964af tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:32.389450 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f8a253b5-940c-4b98-99c4-48585b8964af tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:32.393594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:32.403293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-f8a253b5-940c-4b98-99c4-48585b8964af tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f8a253b5-940c-4b98-99c4-48585b8964af tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d HTTP/1.1 Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:44:32.404836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:44:32.406439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '178c5e10-8273-4f85-8802-ab643a1c9b6d'} Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:44:32.407404 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. Jul 26 16:44:32.409007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:32.410239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f8a253b5-940c-4b98-99c4-48585b8964af tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 178c5e10-8273-4f85-8802-ab643a1c9b6d could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:44:32.410239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f8a253b5-940c-4b98-99c4-48585b8964af tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d" status: 404 len: 111 microversion: 2.1 time: 0.029786 Jul 26 16:44:32.410239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 543/1097] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:32 2022] GET /compute/v2.1/servers/178c5e10-8273-4f85-8802-ab643a1c9b6d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 16:44:33.856826 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2f43a0da-8093-4cd5-aae5-2066c34fee21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:33.857331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2f43a0da-8093-4cd5-aae5-2066c34fee21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:33.859679 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:33.864527 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2f43a0da-8093-4cd5-aae5-2066c34fee21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:33.864972 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2f43a0da-8093-4cd5-aae5-2066c34fee21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:33.865730 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2f43a0da-8093-4cd5-aae5-2066c34fee21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:33.866157 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2f43a0da-8093-4cd5-aae5-2066c34fee21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:33.879870 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-2f43a0da-8093-4cd5-aae5-2066c34fee21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2f43a0da-8093-4cd5-aae5-2066c34fee21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: DELETE /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e HTTP/1.1 Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:44:33.881417 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:44:33.885076 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '10c1c021-13e8-4f87-bcff-9bac39392b1e'} Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:44:33.886020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:44:33.887487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:44:33.889071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2f43a0da-8093-4cd5-aae5-2066c34fee21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:44:33.889071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2f43a0da-8093-4cd5-aae5-2066c34fee21 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "DELETE /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 404 len: 111 microversion: 2.1 time: 0.029860 Jul 26 16:44:33.889071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 555/1098] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:44:33 2022] DELETE /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:44:33.891674 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-af078f01-976e-4e73-b96e-05b764366645 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:33.892277 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-af078f01-976e-4e73-b96e-05b764366645 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] [instance: 10c1c021-13e8-4f87-bcff-9bac39392b1e] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:33.899847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-af078f01-976e-4e73-b96e-05b764366645 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:33.900348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-af078f01-976e-4e73-b96e-05b764366645 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:33.901137 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-af078f01-976e-4e73-b96e-05b764366645 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:33.901565 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-af078f01-976e-4e73-b96e-05b764366645 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:33.914880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-af078f01-976e-4e73-b96e-05b764366645 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] HTTP exception thrown: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-af078f01-976e-4e73-b96e-05b764366645 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Request method failure captured: Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e HTTP/1.1 Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bcovb9RQekC9N3_R5n3t6l3lS16suoOQWB6IMjfJZvQLlIdtyZlrVclvFQHxxVg8eIxHFpHB1vABR79kl6EsCbZJg-mQYhnwCv9OzpqW7JmaSVf7X9wcVflRTS-ubzLmx6OEYhZ-vs6VrUdbCuTR423gPp4gI9T1DY8fWZYCkkOMKw Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:44:33.916468 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/8bb1d794693b410d8c759796d5e20281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_8bb1d794693b410d8c759796d5e20281", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 8bb1d794693b410d8c759796d5e20281 Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1367946130 Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 4c6fffcc3c0d4c49848fa6c2f6b90130 Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeNegativeTest-1367946130-project Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:44:33.918073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '10c1c021-13e8-4f87-bcff-9bac39392b1e'} Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:44:33.918970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. Jul 26 16:44:33.920316 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:44:33.924451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-af078f01-976e-4e73-b96e-05b764366645 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] Returning 404 to user: Instance 10c1c021-13e8-4f87-bcff-9bac39392b1e could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:44:33.924451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-af078f01-976e-4e73-b96e-05b764366645 tempest-AttachVolumeNegativeTest-1367946130 tempest-AttachVolumeNegativeTest-1367946130-project] 10.222.0.144 "GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e" status: 404 len: 111 microversion: 2.1 time: 0.030000 Jul 26 16:44:33.924451 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 544/1099] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:44:33 2022] GET /compute/v2.1/servers/10c1c021-13e8-4f87-bcff-9bac39392b1e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 26 16:44:54.422245 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5833baf4-9e0a-43bc-ad2b-f7bb80f7cc8d tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:44:54.434358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5833baf4-9e0a-43bc-ad2b-f7bb80f7cc8d tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:44:54.434358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=16 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:44:54.434358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5833baf4-9e0a-43bc-ad2b-f7bb80f7cc8d tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:54.434358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5833baf4-9e0a-43bc-ad2b-f7bb80f7cc8d tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:54.434704 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5833baf4-9e0a-43bc-ad2b-f7bb80f7cc8d tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:44:54.434704 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5833baf4-9e0a-43bc-ad2b-f7bb80f7cc8d tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:44:54.514572 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-5833baf4-9e0a-43bc-ad2b-f7bb80f7cc8d tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lazy-loading 'services' on Instance uuid 18cce1f8-c8c3-4494-bf6a-521dd35f147b {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:44:54.966191 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5833baf4-9e0a-43bc-ad2b-f7bb80f7cc8d tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "DELETE /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b/os-volume_attachments/d20e1213-1730-4bb4-a691-56fe043acf7f" status: 202 len: 0 microversion: 2.1 time: 0.547644 Jul 26 16:44:54.966773 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 556/1100] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:44:54 2022] DELETE /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b/os-volume_attachments/d20e1213-1730-4bb4-a691-56fe043acf7f => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:45:02.439379 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1031c355-b396-465f-b536-109b1b483460 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:02.439925 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1031c355-b396-465f-b536-109b1b483460 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:02.442647 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:02.447649 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1031c355-b396-465f-b536-109b1b483460 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:02.448162 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1031c355-b396-465f-b536-109b1b483460 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:02.448947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1031c355-b396-465f-b536-109b1b483460 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:02.449380 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1031c355-b396-465f-b536-109b1b483460 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:02.478637 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1031c355-b396-465f-b536-109b1b483460 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:45:02.995034 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1031c355-b396-465f-b536-109b1b483460 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "DELETE /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 204 len: 0 microversion: 2.1 time: 0.559052 Jul 26 16:45:02.995717 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 545/1101] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:45:02 2022] DELETE /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 0 bytes in 561 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:45:03.005032 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2abf4806-3851-44de-a307-31b4758c22ee tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:03.006312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2abf4806-3851-44de-a307-31b4758c22ee tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:03.012583 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2abf4806-3851-44de-a307-31b4758c22ee tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:03.013034 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2abf4806-3851-44de-a307-31b4758c22ee tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:03.013798 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2abf4806-3851-44de-a307-31b4758c22ee tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:03.014230 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2abf4806-3851-44de-a307-31b4758c22ee tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:03.143253 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2abf4806-3851-44de-a307-31b4758c22ee tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:03.151370 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2abf4806-3851-44de-a307-31b4758c22ee tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1517 microversion: 2.1 time: 0.151202 Jul 26 16:45:03.151933 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 557/1102] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:02 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:04.176249 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-26816b73-c9b6-49e4-ab61-a4cb77675fac tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:04.177354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-26816b73-c9b6-49e4-ab61-a4cb77675fac tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:04.186427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-26816b73-c9b6-49e4-ab61-a4cb77675fac tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:04.187100 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-26816b73-c9b6-49e4-ab61-a4cb77675fac tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:04.188266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-26816b73-c9b6-49e4-ab61-a4cb77675fac tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:04.188950 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-26816b73-c9b6-49e4-ab61-a4cb77675fac tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:04.331513 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-26816b73-c9b6-49e4-ab61-a4cb77675fac tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:04.339502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-26816b73-c9b6-49e4-ab61-a4cb77675fac tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1517 microversion: 2.1 time: 0.170269 Jul 26 16:45:04.340043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 546/1103] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:04 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:05.360289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-af0124a1-82fa-4f10-b8f7-5ee13b59d8dd tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:05.360969 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-af0124a1-82fa-4f10-b8f7-5ee13b59d8dd tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:05.368202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-af0124a1-82fa-4f10-b8f7-5ee13b59d8dd tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:05.368676 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-af0124a1-82fa-4f10-b8f7-5ee13b59d8dd tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:05.369466 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-af0124a1-82fa-4f10-b8f7-5ee13b59d8dd tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:05.369906 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-af0124a1-82fa-4f10-b8f7-5ee13b59d8dd tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:05.502117 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-af0124a1-82fa-4f10-b8f7-5ee13b59d8dd tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:05.509590 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-af0124a1-82fa-4f10-b8f7-5ee13b59d8dd tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1517 microversion: 2.1 time: 0.153141 Jul 26 16:45:05.510082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 558/1104] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:05 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:05.703877 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-7b7bf19a-f950-40bc-bd39-0214eb18b4b3 req-8df55bac-3c96-4348-9b67-51a6224354b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18cce1f8-c8c3-4494-bf6a-521dd35f147b", "name": "network-vif-deleted", "tag": "1482a307-064c-4d1a-a3ee-ba917280bd28"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:45:05.714813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-7b7bf19a-f950-40bc-bd39-0214eb18b4b3 req-8df55bac-3c96-4348-9b67-51a6224354b7 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:05.715365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-7b7bf19a-f950-40bc-bd39-0214eb18b4b3 req-8df55bac-3c96-4348-9b67-51a6224354b7 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:05.727079 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-7b7bf19a-f950-40bc-bd39-0214eb18b4b3 req-8df55bac-3c96-4348-9b67-51a6224354b7 service nova] Creating event network-vif-deleted:1482a307-064c-4d1a-a3ee-ba917280bd28 for instance 18cce1f8-c8c3-4494-bf6a-521dd35f147b on hv-cinder-85104 Jul 26 16:45:05.732146 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-7b7bf19a-f950-40bc-bd39-0214eb18b4b3 req-8df55bac-3c96-4348-9b67-51a6224354b7 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033203 Jul 26 16:45:05.732836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 547/1105] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:45:06.530914 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:06.531458 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:06.538667 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:06.539113 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:06.539877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:06.540312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:06.574331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:06.574774 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:06.575217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lazy-loading 'fault' on Instance uuid 18cce1f8-c8c3-4494-bf6a-521dd35f147b {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:45:06.618968 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af63552b750f4160a257596e3e0f5669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba880373700044f08ba1adbdb416fb55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:06.626897 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6ae3b3ce-7c7d-426f-a622-127b712adfa5 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 200 len: 1313 microversion: 2.1 time: 0.099876 Jul 26 16:45:06.627782 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 559/1106] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:06 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 1313 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:07.648994 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fe34595e-3ce4-4c59-b75d-4ac6a2f54e88 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:07.649619 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fe34595e-3ce4-4c59-b75d-4ac6a2f54e88 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] [instance: 18cce1f8-c8c3-4494-bf6a-521dd35f147b] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:07.656122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe34595e-3ce4-4c59-b75d-4ac6a2f54e88 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:07.656663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe34595e-3ce4-4c59-b75d-4ac6a2f54e88 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:07.657417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe34595e-3ce4-4c59-b75d-4ac6a2f54e88 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:07.657849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fe34595e-3ce4-4c59-b75d-4ac6a2f54e88 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:07.671043 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-fe34595e-3ce4-4c59-b75d-4ac6a2f54e88 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] HTTP exception thrown: Instance 18cce1f8-c8c3-4494-bf6a-521dd35f147b could not be found. Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fe34595e-3ce4-4c59-b75d-4ac6a2f54e88 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Request method failure captured: Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b HTTP/1.1 Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BlPqJMj7FinvbZnzJb1PBAFf7QIn4BRFiptrA12REZIbtCzGJMf0W5_5ktQEGQJK9x7FFkK1jNMvILvO2FQiVD7tPvxD9kVoLJOdti8t6HRSVtDUO-7I-zK-wQKltN428lIZPKR21raJY5xNd8ap6lDH3T1emmXgRrX9A27_nTn7As Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: ba880373700044f08ba1adbdb416fb55 Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-VolumesSnapshotTestJSON-972542290 Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:45:07.672680 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/ba880373700044f08ba1adbdb416fb55"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/ba880373700044f08ba1adbdb416fb55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/ba880373700044f08ba1adbdb416fb55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_ba880373700044f08ba1adbdb416fb55", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-VolumesSnapshotTestJSON-972542290 Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: ba880373700044f08ba1adbdb416fb55 Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-972542290 Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-VolumesSnapshotTestJSON-972542290-project Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: af63552b750f4160a257596e3e0f5669 Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-VolumesSnapshotTestJSON-972542290-project Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 18cce1f8-c8c3-4494-bf6a-521dd35f147b could not be found. Jul 26 16:45:07.688629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '18cce1f8-c8c3-4494-bf6a-521dd35f147b'} Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18cce1f8-c8c3-4494-bf6a-521dd35f147b could not be found. Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:45:07.689435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18cce1f8-c8c3-4494-bf6a-521dd35f147b could not be found. Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18cce1f8-c8c3-4494-bf6a-521dd35f147b could not be found. Jul 26 16:45:07.690746 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:07.692351 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fe34595e-3ce4-4c59-b75d-4ac6a2f54e88 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] Returning 404 to user: Instance 18cce1f8-c8c3-4494-bf6a-521dd35f147b could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:45:07.692351 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fe34595e-3ce4-4c59-b75d-4ac6a2f54e88 tempest-VolumesSnapshotTestJSON-972542290 tempest-VolumesSnapshotTestJSON-972542290-project] 10.222.0.144 "GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b" status: 404 len: 111 microversion: 2.1 time: 0.030029 Jul 26 16:45:07.692351 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 548/1107] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:07 2022] GET /compute/v2.1/servers/18cce1f8-c8c3-4494-bf6a-521dd35f147b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:45:16.582626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1384643505", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "networks": [{"uuid": "0648059d-d4ce-42dd-a1d6-7116b88e34fe"}]}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:45:16.591352 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=11 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:16.625903 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:16.638421 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] validate_networks() for [('0648059d-d4ce-42dd-a1d6-7116b88e34fe', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:45:16.982066 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:45:16.982487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:45:16.982960 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:45:16.983367 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:45:16.983779 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:45:16.993297 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:16.993743 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:16.994570 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:16.995004 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:17.011208 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Getting quotas for project 319ddb5f712b4c8aa6fdaa01e62674f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:45:17.015120 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Getting quotas for user 47c505966b4041788a1efee66df8444f and project 319ddb5f712b4c8aa6fdaa01e62674f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:45:17.026400 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:45:17.028714 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:45:17.210012 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d9f5cc67-e5f6-482f-85b9-98c27e4f9c44 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.630334 Jul 26 16:45:17.210828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 560/1108] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:45:16 2022] POST /compute/v2.1/servers => generated 382 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:45:17.221250 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-12d62e48-e06f-4822-b646-f802f2df89df tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:17.221872 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-12d62e48-e06f-4822-b646-f802f2df89df tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:17.284106 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-12d62e48-e06f-4822-b646-f802f2df89df tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:17.290876 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-12d62e48-e06f-4822-b646-f802f2df89df tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1218 microversion: 2.1 time: 0.073458 Jul 26 16:45:17.291425 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 549/1109] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:17 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:18.189770 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3f0a0387-2c0d-494f-82a9-156fca4d7f48 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:18.192150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3f0a0387-2c0d-494f-82a9-156fca4d7f48 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:18.200024 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3f0a0387-2c0d-494f-82a9-156fca4d7f48 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:18.200491 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3f0a0387-2c0d-494f-82a9-156fca4d7f48 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:18.201253 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3f0a0387-2c0d-494f-82a9-156fca4d7f48 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:18.201686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3f0a0387-2c0d-494f-82a9-156fca4d7f48 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:18.230710 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3f0a0387-2c0d-494f-82a9-156fca4d7f48 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045197 Jul 26 16:45:18.231251 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 561/1110] 10.222.0.144 () {60 vars in 1348 bytes} [Tue Jul 26 16:45:18 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:18.292044 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-64d0e3c6-d769-4c7e-92c0-4df208500a3e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:18.292586 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-64d0e3c6-d769-4c7e-92c0-4df208500a3e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:18.294462 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:18.300445 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-64d0e3c6-d769-4c7e-92c0-4df208500a3e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:18.300906 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-64d0e3c6-d769-4c7e-92c0-4df208500a3e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:18.301654 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-64d0e3c6-d769-4c7e-92c0-4df208500a3e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:18.302083 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-64d0e3c6-d769-4c7e-92c0-4df208500a3e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:18.310796 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-449880f9-d4a9-4b14-883c-1fc59812fdd9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:18.311398 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-449880f9-d4a9-4b14-883c-1fc59812fdd9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:18.358082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-64d0e3c6-d769-4c7e-92c0-4df208500a3e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:45:18.367685 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-449880f9-d4a9-4b14-883c-1fc59812fdd9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:18.374629 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-449880f9-d4a9-4b14-883c-1fc59812fdd9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1218 microversion: 2.1 time: 0.067575 Jul 26 16:45:18.375312 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 562/1111] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:18 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:45:18.833899 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-64d0e3c6-d769-4c7e-92c0-4df208500a3e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "DELETE /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 204 len: 0 microversion: 2.20 time: 0.545340 Jul 26 16:45:18.834479 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 550/1112] 10.222.0.144 () {60 vars in 1285 bytes} [Tue Jul 26 16:45:18 2022] DELETE /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 16:45:18.842505 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3e0f0722-8c19-4cd3-894d-c137bba8ea27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:18.843388 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3e0f0722-8c19-4cd3-894d-c137bba8ea27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:18.849059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3e0f0722-8c19-4cd3-894d-c137bba8ea27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:18.850024 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3e0f0722-8c19-4cd3-894d-c137bba8ea27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:18.850757 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3e0f0722-8c19-4cd3-894d-c137bba8ea27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:18.851185 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3e0f0722-8c19-4cd3-894d-c137bba8ea27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:18.977192 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3e0f0722-8c19-4cd3-894d-c137bba8ea27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:18.985085 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3e0f0722-8c19-4cd3-894d-c137bba8ea27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:18.986592 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3e0f0722-8c19-4cd3-894d-c137bba8ea27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:18.987735 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3e0f0722-8c19-4cd3-894d-c137bba8ea27 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.149106 Jul 26 16:45:18.988288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 563/1113] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:45:18 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:45:19.397351 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d03d57b4-13c5-4dd2-9fa9-9f6d6396a3c2 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:19.398052 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d03d57b4-13c5-4dd2-9fa9-9f6d6396a3c2 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:19.404743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d03d57b4-13c5-4dd2-9fa9-9f6d6396a3c2 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:19.405197 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d03d57b4-13c5-4dd2-9fa9-9f6d6396a3c2 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:19.405958 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d03d57b4-13c5-4dd2-9fa9-9f6d6396a3c2 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:19.406391 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d03d57b4-13c5-4dd2-9fa9-9f6d6396a3c2 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:19.750485 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d03d57b4-13c5-4dd2-9fa9-9f6d6396a3c2 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:19.758705 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d03d57b4-13c5-4dd2-9fa9-9f6d6396a3c2 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1222 microversion: 2.1 time: 0.366479 Jul 26 16:45:19.759259 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 551/1114] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:19 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1222 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:20.010810 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-03b6f936-203b-4ca0-8922-9d511ddb8717 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:20.011337 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-03b6f936-203b-4ca0-8922-9d511ddb8717 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:20.017720 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-03b6f936-203b-4ca0-8922-9d511ddb8717 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:20.018164 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-03b6f936-203b-4ca0-8922-9d511ddb8717 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:20.018919 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-03b6f936-203b-4ca0-8922-9d511ddb8717 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:20.019353 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-03b6f936-203b-4ca0-8922-9d511ddb8717 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:20.153041 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-03b6f936-203b-4ca0-8922-9d511ddb8717 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:20.161562 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-03b6f936-203b-4ca0-8922-9d511ddb8717 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:20.163560 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-03b6f936-203b-4ca0-8922-9d511ddb8717 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:20.164732 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-03b6f936-203b-4ca0-8922-9d511ddb8717 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.157934 Jul 26 16:45:20.165286 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 564/1115] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:45:20 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:45:20.780026 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-883d3fd6-3881-4f06-a433-112722c52bfc tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:20.780855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-883d3fd6-3881-4f06-a433-112722c52bfc tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:20.788592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-883d3fd6-3881-4f06-a433-112722c52bfc tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:20.789117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-883d3fd6-3881-4f06-a433-112722c52bfc tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:20.789962 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-883d3fd6-3881-4f06-a433-112722c52bfc tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:20.790401 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-883d3fd6-3881-4f06-a433-112722c52bfc tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:20.881503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-883d3fd6-3881-4f06-a433-112722c52bfc tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:20.888994 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-883d3fd6-3881-4f06-a433-112722c52bfc tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1214 microversion: 2.1 time: 0.113691 Jul 26 16:45:20.889566 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 552/1116] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:20 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:21.190375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fbedfa53-4955-4a5a-bd61-d9e3dd6c2bcf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:21.190973 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fbedfa53-4955-4a5a-bd61-d9e3dd6c2bcf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:21.198267 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fbedfa53-4955-4a5a-bd61-d9e3dd6c2bcf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:21.198715 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fbedfa53-4955-4a5a-bd61-d9e3dd6c2bcf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:21.199474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fbedfa53-4955-4a5a-bd61-d9e3dd6c2bcf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:21.199905 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fbedfa53-4955-4a5a-bd61-d9e3dd6c2bcf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:21.331684 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fbedfa53-4955-4a5a-bd61-d9e3dd6c2bcf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:21.348043 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fbedfa53-4955-4a5a-bd61-d9e3dd6c2bcf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:21.348043 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fbedfa53-4955-4a5a-bd61-d9e3dd6c2bcf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:21.348043 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fbedfa53-4955-4a5a-bd61-d9e3dd6c2bcf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1727 microversion: 2.20 time: 0.155685 Jul 26 16:45:21.348430 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 565/1117] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:45:21 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:45:21.910408 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c45c0703-1439-4a19-b800-859491eea9fa tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:21.911595 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c45c0703-1439-4a19-b800-859491eea9fa tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:21.918632 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c45c0703-1439-4a19-b800-859491eea9fa tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:21.919176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c45c0703-1439-4a19-b800-859491eea9fa tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:21.920326 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c45c0703-1439-4a19-b800-859491eea9fa tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:21.920870 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c45c0703-1439-4a19-b800-859491eea9fa tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:21.959574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-5f927212-abe1-4bd9-911c-106690a19dd8 req-0cfd9fff-6884-4232-b1de-55989c80e931 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959309a9-7e80-4fa3-a819-5c64c66861e5", "name": "network-vif-deleted", "tag": "5e531cc9-c347-49e5-b738-d36aac7e7939"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:45:21.976228 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-5f927212-abe1-4bd9-911c-106690a19dd8 req-0cfd9fff-6884-4232-b1de-55989c80e931 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:21.977035 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-5f927212-abe1-4bd9-911c-106690a19dd8 req-0cfd9fff-6884-4232-b1de-55989c80e931 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:21.995922 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-5f927212-abe1-4bd9-911c-106690a19dd8 req-0cfd9fff-6884-4232-b1de-55989c80e931 service nova] Creating event network-vif-deleted:5e531cc9-c347-49e5-b738-d36aac7e7939 for instance 959309a9-7e80-4fa3-a819-5c64c66861e5 on hv-cinder-85104 Jul 26 16:45:21.997720 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c45c0703-1439-4a19-b800-859491eea9fa tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:22.002765 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-5f927212-abe1-4bd9-911c-106690a19dd8 req-0cfd9fff-6884-4232-b1de-55989c80e931 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047078 Jul 26 16:45:22.004948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 566/1118] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:45:22.006948 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c45c0703-1439-4a19-b800-859491eea9fa tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1270 microversion: 2.1 time: 0.100408 Jul 26 16:45:22.009681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 553/1119] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:21 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:22.368332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7d17a38d-3a94-4d53-ac73-2ad1ab70c00b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:22.369827 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7d17a38d-3a94-4d53-ac73-2ad1ab70c00b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:22.377253 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7d17a38d-3a94-4d53-ac73-2ad1ab70c00b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:22.377967 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7d17a38d-3a94-4d53-ac73-2ad1ab70c00b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:22.378999 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7d17a38d-3a94-4d53-ac73-2ad1ab70c00b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:22.379660 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7d17a38d-3a94-4d53-ac73-2ad1ab70c00b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:22.455165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7d17a38d-3a94-4d53-ac73-2ad1ab70c00b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:22.464597 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7d17a38d-3a94-4d53-ac73-2ad1ab70c00b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:22.466200 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7d17a38d-3a94-4d53-ac73-2ad1ab70c00b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:22.467429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7d17a38d-3a94-4d53-ac73-2ad1ab70c00b tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1370 microversion: 2.20 time: 0.104791 Jul 26 16:45:22.468053 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 567/1120] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:45:22 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1370 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:45:23.030873 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8964c045-fa49-4e97-885e-a09d0580f9a3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:23.031513 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8964c045-fa49-4e97-885e-a09d0580f9a3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:23.039311 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8964c045-fa49-4e97-885e-a09d0580f9a3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:23.039757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8964c045-fa49-4e97-885e-a09d0580f9a3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:23.040534 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8964c045-fa49-4e97-885e-a09d0580f9a3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:23.040968 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8964c045-fa49-4e97-885e-a09d0580f9a3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:23.104914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8964c045-fa49-4e97-885e-a09d0580f9a3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:23.112524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8964c045-fa49-4e97-885e-a09d0580f9a3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1288 microversion: 2.1 time: 0.085933 Jul 26 16:45:23.113097 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 554/1121] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:23 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:23.489125 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:23.489828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:23.497440 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:23.498622 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:23.498754 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:23.499071 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:23.530472 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:23.530919 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:23.531371 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lazy-loading 'fault' on Instance uuid 959309a9-7e80-4fa3-a819-5c64c66861e5 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:45:23.573378 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:23.579682 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:23.581211 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09de5ea60b9943adacc765b5ecdccb71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6a8f13fe22741d6843f193a0a959e57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:23.582399 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c55a54a2-0960-48ac-a348-690dcd543fdf tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 200 len: 1375 microversion: 2.20 time: 0.097204 Jul 26 16:45:23.582947 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 568/1122] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:45:23 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 1375 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 26 16:45:24.134373 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c6df7399-dcca-48d3-a273-9551f3cc0af5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:24.134990 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c6df7399-dcca-48d3-a273-9551f3cc0af5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:24.141618 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c6df7399-dcca-48d3-a273-9551f3cc0af5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:24.142071 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c6df7399-dcca-48d3-a273-9551f3cc0af5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:24.142837 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c6df7399-dcca-48d3-a273-9551f3cc0af5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:24.143274 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c6df7399-dcca-48d3-a273-9551f3cc0af5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:24.359244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c6df7399-dcca-48d3-a273-9551f3cc0af5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:24.367443 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c6df7399-dcca-48d3-a273-9551f3cc0af5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.237377 Jul 26 16:45:24.368234 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 555/1123] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:24 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:24.606214 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e6b4c479-8393-4a95-bffc-2da8bfdc7869 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:24.606824 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e6b4c479-8393-4a95-bffc-2da8bfdc7869 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:24.612414 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-f2313b30-3af9-48aa-a738-e3ddfdeff028 req-cfc40eb4-d5a7-4644-86f1-09d072e6e370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2", "tag": "a1394839-f04f-4058-ad96-92874c930447"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:45:24.619412 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6b4c479-8393-4a95-bffc-2da8bfdc7869 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:24.620209 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6b4c479-8393-4a95-bffc-2da8bfdc7869 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:24.621172 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6b4c479-8393-4a95-bffc-2da8bfdc7869 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:24.621600 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6b4c479-8393-4a95-bffc-2da8bfdc7869 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:24.622356 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-f2313b30-3af9-48aa-a738-e3ddfdeff028 req-cfc40eb4-d5a7-4644-86f1-09d072e6e370 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:24.622978 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-f2313b30-3af9-48aa-a738-e3ddfdeff028 req-cfc40eb4-d5a7-4644-86f1-09d072e6e370 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:24.634325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-f2313b30-3af9-48aa-a738-e3ddfdeff028 req-cfc40eb4-d5a7-4644-86f1-09d072e6e370 service nova] Creating event network-changed:a1394839-f04f-4058-ad96-92874c930447 for instance f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 on hv-cinder-85104 Jul 26 16:45:24.636675 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-e6b4c479-8393-4a95-bffc-2da8bfdc7869 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] HTTP exception thrown: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e6b4c479-8393-4a95-bffc-2da8bfdc7869 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Request method failure captured: Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 HTTP/1.1 Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bec7vAywfGhryLpnnhkvmFf-2F1cB1wUOtlUI8gy6ZMMl7Pxch5VXFpdLebg6ifqDw22fw_KOyucGkiZcFCzrysqCKpS5c5EehPlV3n_74uZusBYzHxeL3NfKwNAiJOOx_Tdoornb-437tvf4_zcjzD4NQlYiE7uzLhKa0VLb4tQiA Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:45:24.638480 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_f6a8f13fe22741d6843f193a0a959e57", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 09de5ea60b9943adacc765b5ecdccb71 Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:24.640177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '959309a9-7e80-4fa3-a819-5c64c66861e5'} Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:45:24.641181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:24.642699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:24.644446 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e6b4c479-8393-4a95-bffc-2da8bfdc7869 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Returning 404 to user: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:45:24.644545 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-f2313b30-3af9-48aa-a738-e3ddfdeff028 req-cfc40eb4-d5a7-4644-86f1-09d072e6e370 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030447 Jul 26 16:45:24.644668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e6b4c479-8393-4a95-bffc-2da8bfdc7869 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 404 len: 111 microversion: 2.20 time: 0.038090 Jul 26 16:45:24.644763 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 556/1124] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:45:24.644853 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 569/1125] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:45:24 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 16:45:24.653082 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f0b71bfc-c4ff-4451-9be8-81f754ff8221 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '.version_select at 0x7f4b6c1b0280>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:24.841605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f0b71bfc-c4ff-4451-9be8-81f754ff8221 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772132431" status: 204 len: 0 microversion: 2.20 time: 0.192579 Jul 26 16:45:24.842254 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 557/1126] 10.222.0.144 () {60 vars in 1267 bytes} [Tue Jul 26 16:45:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1772132431 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 26 16:45:25.389766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-013001d4-f1e6-4904-a4bc-070e879f6344 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:25.390376 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-013001d4-f1e6-4904-a4bc-070e879f6344 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:25.397006 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-013001d4-f1e6-4904-a4bc-070e879f6344 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:25.397456 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-013001d4-f1e6-4904-a4bc-070e879f6344 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:25.398224 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-013001d4-f1e6-4904-a4bc-070e879f6344 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:25.398659 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-013001d4-f1e6-4904-a4bc-070e879f6344 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:25.586256 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-013001d4-f1e6-4904-a4bc-070e879f6344 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:25.593948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-013001d4-f1e6-4904-a4bc-070e879f6344 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.208083 Jul 26 16:45:25.594512 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 570/1127] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:25 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:26.615113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-97ea78ef-27df-4e95-8180-53c2091fd4d9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:26.616373 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-97ea78ef-27df-4e95-8180-53c2091fd4d9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:26.622984 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-97ea78ef-27df-4e95-8180-53c2091fd4d9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:26.623427 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-97ea78ef-27df-4e95-8180-53c2091fd4d9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:26.624174 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-97ea78ef-27df-4e95-8180-53c2091fd4d9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:26.624634 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-97ea78ef-27df-4e95-8180-53c2091fd4d9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:26.760439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-97ea78ef-27df-4e95-8180-53c2091fd4d9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:26.767707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-97ea78ef-27df-4e95-8180-53c2091fd4d9 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.156857 Jul 26 16:45:26.768255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 558/1128] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:26 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:27.787474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ed106362-8b73-4c55-a252-504e166de8b8 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:27.788022 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ed106362-8b73-4c55-a252-504e166de8b8 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:27.790395 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:27.795294 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ed106362-8b73-4c55-a252-504e166de8b8 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:27.795740 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ed106362-8b73-4c55-a252-504e166de8b8 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:27.796522 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ed106362-8b73-4c55-a252-504e166de8b8 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:27.796960 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ed106362-8b73-4c55-a252-504e166de8b8 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:27.928557 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ed106362-8b73-4c55-a252-504e166de8b8 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:27.935917 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ed106362-8b73-4c55-a252-504e166de8b8 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.152779 Jul 26 16:45:27.936493 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 571/1129] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:27 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:28.956788 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ff36411f-a174-4f3c-ae00-44718f6a95e6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:28.957435 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ff36411f-a174-4f3c-ae00-44718f6a95e6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:28.959437 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:28.964756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ff36411f-a174-4f3c-ae00-44718f6a95e6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:28.965208 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ff36411f-a174-4f3c-ae00-44718f6a95e6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:28.965974 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ff36411f-a174-4f3c-ae00-44718f6a95e6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:28.966407 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ff36411f-a174-4f3c-ae00-44718f6a95e6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:29.091342 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ff36411f-a174-4f3c-ae00-44718f6a95e6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:29.098849 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ff36411f-a174-4f3c-ae00-44718f6a95e6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.145900 Jul 26 16:45:29.099914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 559/1130] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:28 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:30.119572 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fe0df5f8-4d73-4a21-a1b5-c0301330be16 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:30.120179 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fe0df5f8-4d73-4a21-a1b5-c0301330be16 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:30.122217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=8 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:30.127199 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fe0df5f8-4d73-4a21-a1b5-c0301330be16 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:30.127647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fe0df5f8-4d73-4a21-a1b5-c0301330be16 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:30.128431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fe0df5f8-4d73-4a21-a1b5-c0301330be16 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:30.128869 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-fe0df5f8-4d73-4a21-a1b5-c0301330be16 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:30.258927 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fe0df5f8-4d73-4a21-a1b5-c0301330be16 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:30.266191 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fe0df5f8-4d73-4a21-a1b5-c0301330be16 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.150542 Jul 26 16:45:30.266742 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 572/1131] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:30 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:30.446142 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0080d288-fb8a-4335-8a27-c8b788fcf10a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:30.446664 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0080d288-fb8a-4335-8a27-c8b788fcf10a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:30.453350 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0080d288-fb8a-4335-8a27-c8b788fcf10a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:30.453800 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0080d288-fb8a-4335-8a27-c8b788fcf10a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:30.454557 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0080d288-fb8a-4335-8a27-c8b788fcf10a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:30.454988 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0080d288-fb8a-4335-8a27-c8b788fcf10a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:30.468827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-0080d288-fb8a-4335-8a27-c8b788fcf10a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] HTTP exception thrown: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0080d288-fb8a-4335-8a27-c8b788fcf10a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Request method failure captured: Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: DELETE /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 HTTP/1.1 Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bec7vAywfGhryLpnnhkvmFf-2F1cB1wUOtlUI8gy6ZMMl7Pxch5VXFpdLebg6ifqDw22fw_KOyucGkiZcFCzrysqCKpS5c5EehPlV3n_74uZusBYzHxeL3NfKwNAiJOOx_Tdoornb-437tvf4_zcjzD4NQlYiE7uzLhKa0VLb4tQiA Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:45:30.470592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_f6a8f13fe22741d6843f193a0a959e57", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 09de5ea60b9943adacc765b5ecdccb71 Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:30.472175 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '959309a9-7e80-4fa3-a819-5c64c66861e5'} Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:45:30.473027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:30.474359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:30.475696 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0080d288-fb8a-4335-8a27-c8b788fcf10a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Returning 404 to user: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:45:30.475696 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0080d288-fb8a-4335-8a27-c8b788fcf10a tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "DELETE /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 404 len: 111 microversion: 2.20 time: 0.030857 Jul 26 16:45:30.475696 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 560/1132] 10.222.0.144 () {60 vars in 1285 bytes} [Tue Jul 26 16:45:30 2022] DELETE /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 16:45:30.480907 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c776f67d-ab87-497d-9790-2fe37dac24e3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:30.481509 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c776f67d-ab87-497d-9790-2fe37dac24e3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: 959309a9-7e80-4fa3-a819-5c64c66861e5] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:30.487724 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c776f67d-ab87-497d-9790-2fe37dac24e3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:30.488173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c776f67d-ab87-497d-9790-2fe37dac24e3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:30.488972 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c776f67d-ab87-497d-9790-2fe37dac24e3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:30.489409 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c776f67d-ab87-497d-9790-2fe37dac24e3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:30.503632 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-c776f67d-ab87-497d-9790-2fe37dac24e3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] HTTP exception thrown: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c776f67d-ab87-497d-9790-2fe37dac24e3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Request method failure captured: Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 HTTP/1.1 Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bec7vAywfGhryLpnnhkvmFf-2F1cB1wUOtlUI8gy6ZMMl7Pxch5VXFpdLebg6ifqDw22fw_KOyucGkiZcFCzrysqCKpS5c5EehPlV3n_74uZusBYzHxeL3NfKwNAiJOOx_Tdoornb-437tvf4_zcjzD4NQlYiE7uzLhKa0VLb4tQiA Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:45:30.505341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_f6a8f13fe22741d6843f193a0a959e57", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 09de5ea60b9943adacc765b5ecdccb71 Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:30.507365 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '959309a9-7e80-4fa3-a819-5c64c66861e5'} Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:45:30.508128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. Jul 26 16:45:30.509647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:30.511173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c776f67d-ab87-497d-9790-2fe37dac24e3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Returning 404 to user: Instance 959309a9-7e80-4fa3-a819-5c64c66861e5 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:45:30.511173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c776f67d-ab87-497d-9790-2fe37dac24e3 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5" status: 404 len: 111 microversion: 2.20 time: 0.030885 Jul 26 16:45:30.511173 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 573/1133] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:45:30 2022] GET /compute/v2.1/servers/959309a9-7e80-4fa3-a819-5c64c66861e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 16:45:31.287743 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3732df43-39b2-41f1-a90d-2ee66f661c23 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:31.288259 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3732df43-39b2-41f1-a90d-2ee66f661c23 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:31.295423 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3732df43-39b2-41f1-a90d-2ee66f661c23 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:31.296001 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3732df43-39b2-41f1-a90d-2ee66f661c23 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:31.296809 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3732df43-39b2-41f1-a90d-2ee66f661c23 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:31.300309 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3732df43-39b2-41f1-a90d-2ee66f661c23 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:31.425499 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3732df43-39b2-41f1-a90d-2ee66f661c23 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:31.433516 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3732df43-39b2-41f1-a90d-2ee66f661c23 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.150693 Jul 26 16:45:31.434079 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 561/1134] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:31 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:32.454177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2d6d0ac2-0744-43f5-b934-db95be4ebc00 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:32.454776 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2d6d0ac2-0744-43f5-b934-db95be4ebc00 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:32.461358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d6d0ac2-0744-43f5-b934-db95be4ebc00 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:32.461797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d6d0ac2-0744-43f5-b934-db95be4ebc00 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:32.462546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d6d0ac2-0744-43f5-b934-db95be4ebc00 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:32.462974 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2d6d0ac2-0744-43f5-b934-db95be4ebc00 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:32.593325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2d6d0ac2-0744-43f5-b934-db95be4ebc00 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:32.600838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2d6d0ac2-0744-43f5-b934-db95be4ebc00 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.150377 Jul 26 16:45:32.601333 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 574/1135] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:32 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:33.155328 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-47fbea82-b9ca-4260-9253-11102839b296 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:33.156502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-47fbea82-b9ca-4260-9253-11102839b296 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:33.158267 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:33.163861 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-47fbea82-b9ca-4260-9253-11102839b296 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:33.164333 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-47fbea82-b9ca-4260-9253-11102839b296 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:33.165116 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-47fbea82-b9ca-4260-9253-11102839b296 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:33.165556 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-47fbea82-b9ca-4260-9253-11102839b296 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:33.178704 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-47fbea82-b9ca-4260-9253-11102839b296 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] HTTP exception thrown: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-47fbea82-b9ca-4260-9253-11102839b296 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Request method failure captured: Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: DELETE /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 HTTP/1.1 Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bec7vAywfGhryLpnnhkvmFf-2F1cB1wUOtlUI8gy6ZMMl7Pxch5VXFpdLebg6ifqDw22fw_KOyucGkiZcFCzrysqCKpS5c5EehPlV3n_74uZusBYzHxeL3NfKwNAiJOOx_Tdoornb-437tvf4_zcjzD4NQlYiE7uzLhKa0VLb4tQiA Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:45:33.180217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_f6a8f13fe22741d6843f193a0a959e57", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 09de5ea60b9943adacc765b5ecdccb71 Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:45:33.181921 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': 'd182cbe3-dff4-482c-a901-f084fc7b0077'} Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:45:33.182847 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:45:33.184548 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:33.186134 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-47fbea82-b9ca-4260-9253-11102839b296 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Returning 404 to user: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:45:33.186134 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-47fbea82-b9ca-4260-9253-11102839b296 tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "DELETE /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 404 len: 111 microversion: 2.20 time: 0.030259 Jul 26 16:45:33.186134 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 562/1136] 10.222.0.144 () {60 vars in 1285 bytes} [Tue Jul 26 16:45:33 2022] DELETE /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 16:45:33.191375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4f4f9363-4209-4215-a3ef-0e49fe4aa89e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:33.191980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-4f4f9363-4209-4215-a3ef-0e49fe4aa89e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] [instance: d182cbe3-dff4-482c-a901-f084fc7b0077] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:33.198040 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4f4f9363-4209-4215-a3ef-0e49fe4aa89e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:33.198487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4f4f9363-4209-4215-a3ef-0e49fe4aa89e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:33.199240 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4f4f9363-4209-4215-a3ef-0e49fe4aa89e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:33.199673 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-4f4f9363-4209-4215-a3ef-0e49fe4aa89e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:33.213306 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-4f4f9363-4209-4215-a3ef-0e49fe4aa89e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] HTTP exception thrown: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4f4f9363-4209-4215-a3ef-0e49fe4aa89e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Request method failure captured: Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 HTTP/1.1 Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bec7vAywfGhryLpnnhkvmFf-2F1cB1wUOtlUI8gy6ZMMl7Pxch5VXFpdLebg6ifqDw22fw_KOyucGkiZcFCzrysqCKpS5c5EehPlV3n_74uZusBYzHxeL3NfKwNAiJOOx_Tdoornb-437tvf4_zcjzD4NQlYiE7uzLhKa0VLb4tQiA Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Openstack-Nova-Api-Version: 2.20 Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:45:33.214849 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/f6a8f13fe22741d6843f193a0a959e57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_f6a8f13fe22741d6843f193a0a959e57", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: f6a8f13fe22741d6843f193a0a959e57 Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2049800386 Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: 09de5ea60b9943adacc765b5ecdccb71 Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2049800386-project Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:45:33.216877 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': 'd182cbe3-dff4-482c-a901-f084fc7b0077'} Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:45:33.218078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. Jul 26 16:45:33.219598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:45:33.220909 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4f4f9363-4209-4215-a3ef-0e49fe4aa89e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] Returning 404 to user: Instance d182cbe3-dff4-482c-a901-f084fc7b0077 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:45:33.220909 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4f4f9363-4209-4215-a3ef-0e49fe4aa89e tempest-AttachVolumeShelveTestJSON-2049800386 tempest-AttachVolumeShelveTestJSON-2049800386-project] 10.222.0.144 "GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077" status: 404 len: 111 microversion: 2.20 time: 0.028744 Jul 26 16:45:33.220909 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 575/1137] 10.222.0.144 () {60 vars in 1282 bytes} [Tue Jul 26 16:45:33 2022] GET /compute/v2.1/servers/d182cbe3-dff4-482c-a901-f084fc7b0077 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 26 16:45:33.621519 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-67eab6b6-0c98-4fb0-916f-4b63fdbc4c51 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:33.622142 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-67eab6b6-0c98-4fb0-916f-4b63fdbc4c51 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:33.628880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-67eab6b6-0c98-4fb0-916f-4b63fdbc4c51 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:33.629341 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-67eab6b6-0c98-4fb0-916f-4b63fdbc4c51 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:33.630117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-67eab6b6-0c98-4fb0-916f-4b63fdbc4c51 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:33.630590 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-67eab6b6-0c98-4fb0-916f-4b63fdbc4c51 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:33.781444 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-67eab6b6-0c98-4fb0-916f-4b63fdbc4c51 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:33.790896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-67eab6b6-0c98-4fb0-916f-4b63fdbc4c51 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.173064 Jul 26 16:45:33.805218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 563/1138] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:33 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:34.811723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5a52fb7a-28b9-4018-a9ed-5314d4b5c09d tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:34.812243 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5a52fb7a-28b9-4018-a9ed-5314d4b5c09d tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:34.818637 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a52fb7a-28b9-4018-a9ed-5314d4b5c09d tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:34.819336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a52fb7a-28b9-4018-a9ed-5314d4b5c09d tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:34.820277 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a52fb7a-28b9-4018-a9ed-5314d4b5c09d tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:34.820732 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5a52fb7a-28b9-4018-a9ed-5314d4b5c09d tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:35.021247 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-5a52fb7a-28b9-4018-a9ed-5314d4b5c09d tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:35.028736 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5a52fb7a-28b9-4018-a9ed-5314d4b5c09d tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.220892 Jul 26 16:45:35.029293 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 576/1139] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:34 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:35.530131 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-a81b972d-be05-452f-bdb3-973f02ccc667 req-df030c22-0ff6-453a-99d7-f81076b6262d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2", "name": "network-vif-plugged", "status": "completed", "tag": "a1394839-f04f-4058-ad96-92874c930447"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:45:35.541851 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-a81b972d-be05-452f-bdb3-973f02ccc667 req-df030c22-0ff6-453a-99d7-f81076b6262d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:35.542581 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-a81b972d-be05-452f-bdb3-973f02ccc667 req-df030c22-0ff6-453a-99d7-f81076b6262d service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:35.553914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-a81b972d-be05-452f-bdb3-973f02ccc667 req-df030c22-0ff6-453a-99d7-f81076b6262d service nova] Creating event network-vif-plugged:a1394839-f04f-4058-ad96-92874c930447 for instance f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 on hv-cinder-85104 Jul 26 16:45:35.561007 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-a81b972d-be05-452f-bdb3-973f02ccc667 req-df030c22-0ff6-453a-99d7-f81076b6262d service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034888 Jul 26 16:45:35.561603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 564/1140] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:45:36.059649 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0902e37a-0518-4840-b2c8-5138cb55c7e1 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:36.061020 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0902e37a-0518-4840-b2c8-5138cb55c7e1 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:36.068150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0902e37a-0518-4840-b2c8-5138cb55c7e1 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:36.068628 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0902e37a-0518-4840-b2c8-5138cb55c7e1 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:36.069416 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0902e37a-0518-4840-b2c8-5138cb55c7e1 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:36.069842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0902e37a-0518-4840-b2c8-5138cb55c7e1 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:36.274327 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0902e37a-0518-4840-b2c8-5138cb55c7e1 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:36.282061 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0902e37a-0518-4840-b2c8-5138cb55c7e1 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.226873 Jul 26 16:45:36.282801 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 577/1141] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:36 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:37.304459 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ce238584-2a20-47de-ae66-531c18066d1e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:37.305272 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ce238584-2a20-47de-ae66-531c18066d1e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:37.311848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ce238584-2a20-47de-ae66-531c18066d1e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:37.312417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ce238584-2a20-47de-ae66-531c18066d1e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:37.313179 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ce238584-2a20-47de-ae66-531c18066d1e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:37.313611 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ce238584-2a20-47de-ae66-531c18066d1e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:37.500860 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ce238584-2a20-47de-ae66-531c18066d1e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:37.508417 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ce238584-2a20-47de-ae66-531c18066d1e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1318 microversion: 2.1 time: 0.209600 Jul 26 16:45:37.508980 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 565/1142] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:37 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:38.529979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a1f205a2-9595-4af4-8082-e6402b96cca5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:38.530579 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a1f205a2-9595-4af4-8082-e6402b96cca5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:38.537951 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1f205a2-9595-4af4-8082-e6402b96cca5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:38.538394 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1f205a2-9595-4af4-8082-e6402b96cca5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:38.539398 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1f205a2-9595-4af4-8082-e6402b96cca5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:38.539834 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a1f205a2-9595-4af4-8082-e6402b96cca5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:38.669697 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a1f205a2-9595-4af4-8082-e6402b96cca5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:38.677212 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a1f205a2-9595-4af4-8082-e6402b96cca5 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1503 microversion: 2.1 time: 0.151449 Jul 26 16:45:38.677769 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 578/1143] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:38 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:39.879516 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ea775750-7962-4b7b-b86b-a457ebd321c3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:39.880009 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ea775750-7962-4b7b-b86b-a457ebd321c3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:39.886279 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ea775750-7962-4b7b-b86b-a457ebd321c3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:39.886734 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ea775750-7962-4b7b-b86b-a457ebd321c3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:39.887502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ea775750-7962-4b7b-b86b-a457ebd321c3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:39.887942 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ea775750-7962-4b7b-b86b-a457ebd321c3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:39.915457 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ea775750-7962-4b7b-b86b-a457ebd321c3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:45:40.058005 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:40.285925 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ea775750-7962-4b7b-b86b-a457ebd321c3 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "DELETE /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 204 len: 0 microversion: 2.1 time: 0.409905 Jul 26 16:45:40.287011 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 566/1144] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:45:39 2022] DELETE /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:45:40.295063 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-02473a5c-3c43-40b8-bd84-3582bd93a474 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:40.295668 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-02473a5c-3c43-40b8-bd84-3582bd93a474 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:40.302250 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-02473a5c-3c43-40b8-bd84-3582bd93a474 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:40.302699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-02473a5c-3c43-40b8-bd84-3582bd93a474 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:40.303468 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-02473a5c-3c43-40b8-bd84-3582bd93a474 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:40.303898 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-02473a5c-3c43-40b8-bd84-3582bd93a474 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:40.441169 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-02473a5c-3c43-40b8-bd84-3582bd93a474 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:40.449241 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-02473a5c-3c43-40b8-bd84-3582bd93a474 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1509 microversion: 2.1 time: 0.157989 Jul 26 16:45:40.449838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 579/1145] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:40 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:41.472794 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-017a3db1-755e-47a2-8b15-1678fd8c2664 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:41.472794 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-017a3db1-755e-47a2-8b15-1678fd8c2664 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:41.481086 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-017a3db1-755e-47a2-8b15-1678fd8c2664 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:41.481595 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-017a3db1-755e-47a2-8b15-1678fd8c2664 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:41.483018 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-017a3db1-755e-47a2-8b15-1678fd8c2664 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:41.483780 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-017a3db1-755e-47a2-8b15-1678fd8c2664 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:41.657057 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-017a3db1-755e-47a2-8b15-1678fd8c2664 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:41.665308 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-017a3db1-755e-47a2-8b15-1678fd8c2664 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1509 microversion: 2.1 time: 0.197993 Jul 26 16:45:41.665874 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 567/1146] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:41 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:42.688949 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f76733cf-66e3-42f1-b36b-9734e73bdb4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:42.689567 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f76733cf-66e3-42f1-b36b-9734e73bdb4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:42.698144 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f76733cf-66e3-42f1-b36b-9734e73bdb4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:42.698613 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f76733cf-66e3-42f1-b36b-9734e73bdb4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:42.699371 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f76733cf-66e3-42f1-b36b-9734e73bdb4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:42.699803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f76733cf-66e3-42f1-b36b-9734e73bdb4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:42.721431 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=100 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:42.772510 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f76733cf-66e3-42f1-b36b-9734e73bdb4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:42.786242 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f76733cf-66e3-42f1-b36b-9734e73bdb4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1467 microversion: 2.1 time: 0.103590 Jul 26 16:45:42.792839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 580/1147] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:42 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1467 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:42.864727 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-92cd5de0-f061-4ddb-ab48-0f961cb525b8 req-f6f0dc0e-d727-4353-89da-166a438ef372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2", "name": "network-vif-deleted", "tag": "a1394839-f04f-4058-ad96-92874c930447"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:45:42.875348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-92cd5de0-f061-4ddb-ab48-0f961cb525b8 req-f6f0dc0e-d727-4353-89da-166a438ef372 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:42.875870 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-92cd5de0-f061-4ddb-ab48-0f961cb525b8 req-f6f0dc0e-d727-4353-89da-166a438ef372 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:42.888710 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-92cd5de0-f061-4ddb-ab48-0f961cb525b8 req-f6f0dc0e-d727-4353-89da-166a438ef372 service nova] Creating event network-vif-deleted:a1394839-f04f-4058-ad96-92874c930447 for instance f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 on hv-cinder-85104 Jul 26 16:45:42.893562 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-92cd5de0-f061-4ddb-ab48-0f961cb525b8 req-f6f0dc0e-d727-4353-89da-166a438ef372 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174554 Jul 26 16:45:42.894168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 568/1148] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:45:43.807525 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:43.810412 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:43.814737 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:43.815191 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:43.815965 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:43.816418 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:43.849692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:43.850206 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:43.850722 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lazy-loading 'fault' on Instance uuid f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:45:43.895061 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:43.903080 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ab1a5870-83ee-4b86-8111-42c115dd9071 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 200 len: 1308 microversion: 2.1 time: 0.099819 Jul 26 16:45:43.903635 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 581/1149] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:43 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:44.928258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fa306cd0-2bfd-48c9-9015-70aa50c65385 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:44.929803 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fa306cd0-2bfd-48c9-9015-70aa50c65385 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:44.940728 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa306cd0-2bfd-48c9-9015-70aa50c65385 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:44.940728 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa306cd0-2bfd-48c9-9015-70aa50c65385 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:44.940728 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa306cd0-2bfd-48c9-9015-70aa50c65385 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:44.940728 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fa306cd0-2bfd-48c9-9015-70aa50c65385 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:44.953077 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-fa306cd0-2bfd-48c9-9015-70aa50c65385 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] HTTP exception thrown: Instance f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 could not be found. Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fa306cd0-2bfd-48c9-9015-70aa50c65385 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Request method failure captured: Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 HTTP/1.1 Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BoY5v2FJ9tMrrBUgUHGu2yeww0cUg4NDrDAPYqkm0MGz-JCfrplliyoqvsAbRY0Fvj1QyjBB09X9x9Sb0FydLnJZdeCUStab6n4OQrEq7_bBjMxbn71dIS03xxSRFQ17mlO1HnaNi4dVl7iHBY3ikwfOatw_eNFU_1P6fhESxZ-VwE Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 319ddb5f712b4c8aa6fdaa01e62674f0 Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-VolumesActionsTest-1155833300 Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:45:44.954771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/319ddb5f712b4c8aa6fdaa01e62674f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/319ddb5f712b4c8aa6fdaa01e62674f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/319ddb5f712b4c8aa6fdaa01e62674f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_319ddb5f712b4c8aa6fdaa01e62674f0", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-VolumesActionsTest-1155833300 Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 319ddb5f712b4c8aa6fdaa01e62674f0 Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-VolumesActionsTest-1155833300 Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-VolumesActionsTest-1155833300-project Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 47c505966b4041788a1efee66df8444f Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-VolumesActionsTest-1155833300-project Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 could not be found. Jul 26 16:45:44.956620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': 'f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2'} Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 could not be found. Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:45:44.957754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 could not be found. Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 could not be found. Jul 26 16:45:44.959693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:45:44.960967 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fa306cd0-2bfd-48c9-9015-70aa50c65385 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Returning 404 to user: Instance f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:45:44.960967 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fa306cd0-2bfd-48c9-9015-70aa50c65385 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2" status: 404 len: 111 microversion: 2.1 time: 0.032930 Jul 26 16:45:44.960967 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 569/1150] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:44 2022] GET /compute/v2.1/servers/f5a85c9f-2a1c-41f3-8dc3-5e13166f34c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:45:45.076380 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-764556593", "imageRef": "0b9118dd-3851-4e03-bf3f-79772594a1cc", "flavorRef": "452", "networks": [{"uuid": "0648059d-d4ce-42dd-a1d6-7116b88e34fe"}]}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:45:45.133217 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] validate_networks() for [('0648059d-d4ce-42dd-a1d6-7116b88e34fe', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:45:45.479863 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:45:45.480286 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:45:45.480854 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:45:45.481291 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:45:45.481702 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:45:45.490512 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:45.490980 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:45.491824 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:45.492202 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:45.508335 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Getting quotas for project 319ddb5f712b4c8aa6fdaa01e62674f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:45:45.512182 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Getting quotas for user 47c505966b4041788a1efee66df8444f and project 319ddb5f712b4c8aa6fdaa01e62674f0. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:45:45.523247 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:45:45.525499 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0b9118dd-3851-4e03-bf3f-79772594a1cc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:45:45.875553 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ba1357b4-904c-43c9-9439-4d5633582581 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.803134 Jul 26 16:45:45.876198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 582/1151] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:45:45 2022] POST /compute/v2.1/servers => generated 382 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:45:45.888073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7e993975-9c13-4ebd-a29c-f831a1c2a853 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:45.888808 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7e993975-9c13-4ebd-a29c-f831a1c2a853 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:45.944731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7e993975-9c13-4ebd-a29c-f831a1c2a853 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:45.956080 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7e993975-9c13-4ebd-a29c-f831a1c2a853 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1217 microversion: 2.1 time: 0.070998 Jul 26 16:45:45.956080 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 570/1152] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:45 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:46.977760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9eae43a2-e870-4b83-b3c1-8b03688fdc79 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:46.978405 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9eae43a2-e870-4b83-b3c1-8b03688fdc79 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:46.980426 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:47.032967 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-9eae43a2-e870-4b83-b3c1-8b03688fdc79 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:47.040853 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9eae43a2-e870-4b83-b3c1-8b03688fdc79 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1217 microversion: 2.1 time: 0.068386 Jul 26 16:45:47.041418 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 583/1153] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:46 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:48.062344 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-417782ab-db9a-4e23-aa65-8856accd9bcf tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:48.062896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-417782ab-db9a-4e23-aa65-8856accd9bcf tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:48.069345 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-417782ab-db9a-4e23-aa65-8856accd9bcf tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:48.069896 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-417782ab-db9a-4e23-aa65-8856accd9bcf tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:48.070905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-417782ab-db9a-4e23-aa65-8856accd9bcf tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:48.071359 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-417782ab-db9a-4e23-aa65-8856accd9bcf tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:48.133305 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-417782ab-db9a-4e23-aa65-8856accd9bcf tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:48.140753 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-417782ab-db9a-4e23-aa65-8856accd9bcf tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1269 microversion: 2.1 time: 0.082652 Jul 26 16:45:48.141305 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 571/1154] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:48 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1269 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:49.162349 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d29d04d5-17a2-41b1-9e07-e670640025ee tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:49.162952 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d29d04d5-17a2-41b1-9e07-e670640025ee tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:49.169850 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d29d04d5-17a2-41b1-9e07-e670640025ee tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:49.170289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d29d04d5-17a2-41b1-9e07-e670640025ee tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:49.171039 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d29d04d5-17a2-41b1-9e07-e670640025ee tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:49.171467 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d29d04d5-17a2-41b1-9e07-e670640025ee tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:49.231778 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d29d04d5-17a2-41b1-9e07-e670640025ee tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:49.239251 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d29d04d5-17a2-41b1-9e07-e670640025ee tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1269 microversion: 2.1 time: 0.081079 Jul 26 16:45:49.240332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 584/1155] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:49 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:50.259754 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-f377be34-f6f6-42d6-86c1-dbe350abe8a6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:50.260372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-f377be34-f6f6-42d6-86c1-dbe350abe8a6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:50.267051 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f377be34-f6f6-42d6-86c1-dbe350abe8a6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:50.267536 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f377be34-f6f6-42d6-86c1-dbe350abe8a6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:50.268305 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f377be34-f6f6-42d6-86c1-dbe350abe8a6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:50.268779 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-f377be34-f6f6-42d6-86c1-dbe350abe8a6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:50.329073 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-f377be34-f6f6-42d6-86c1-dbe350abe8a6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:50.336903 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-f377be34-f6f6-42d6-86c1-dbe350abe8a6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1269 microversion: 2.1 time: 0.081542 Jul 26 16:45:50.337458 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 572/1156] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:50 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1269 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:51.357336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e6489674-bd01-41ea-a37d-f51749692c4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:51.357939 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e6489674-bd01-41ea-a37d-f51749692c4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:51.364330 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6489674-bd01-41ea-a37d-f51749692c4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:51.364807 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6489674-bd01-41ea-a37d-f51749692c4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:51.365559 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6489674-bd01-41ea-a37d-f51749692c4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:51.366021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e6489674-bd01-41ea-a37d-f51749692c4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:51.426935 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e6489674-bd01-41ea-a37d-f51749692c4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:51.434320 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e6489674-bd01-41ea-a37d-f51749692c4e tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1269 microversion: 2.1 time: 0.080830 Jul 26 16:45:51.434889 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 585/1157] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:51 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1269 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:52.454958 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cac561b4-12f7-4861-9317-2fc5c63e8f13 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:52.455583 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cac561b4-12f7-4861-9317-2fc5c63e8f13 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:52.461563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cac561b4-12f7-4861-9317-2fc5c63e8f13 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:52.462015 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cac561b4-12f7-4861-9317-2fc5c63e8f13 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:52.462766 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cac561b4-12f7-4861-9317-2fc5c63e8f13 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:52.463194 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cac561b4-12f7-4861-9317-2fc5c63e8f13 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:52.529949 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cac561b4-12f7-4861-9317-2fc5c63e8f13 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:52.538586 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cac561b4-12f7-4861-9317-2fc5c63e8f13 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1275 microversion: 2.1 time: 0.087634 Jul 26 16:45:52.552728 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 573/1158] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:52 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1275 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:53.559755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-72439211-82ca-46ac-9e08-87da525b4081 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:53.560363 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-72439211-82ca-46ac-9e08-87da525b4081 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:53.567077 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-72439211-82ca-46ac-9e08-87da525b4081 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:53.568457 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-72439211-82ca-46ac-9e08-87da525b4081 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:53.569283 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-72439211-82ca-46ac-9e08-87da525b4081 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:53.569669 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-72439211-82ca-46ac-9e08-87da525b4081 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:53.773563 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-72439211-82ca-46ac-9e08-87da525b4081 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:53.781053 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-72439211-82ca-46ac-9e08-87da525b4081 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1317 microversion: 2.1 time: 0.225485 Jul 26 16:45:53.781611 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 586/1159] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:53 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:53.945525 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-bb7f4c83-0718-48b7-8085-d7c098c69731 req-03e8f8af-f5c7-420a-b991-61755622f61a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "798f4740-c14e-43e0-a02f-dba9d09efced", "tag": "9f6689db-3748-44b1-8744-c649526fb091"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:45:53.960009 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-bb7f4c83-0718-48b7-8085-d7c098c69731 req-03e8f8af-f5c7-420a-b991-61755622f61a service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:53.961065 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-bb7f4c83-0718-48b7-8085-d7c098c69731 req-03e8f8af-f5c7-420a-b991-61755622f61a service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:53.972349 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-bb7f4c83-0718-48b7-8085-d7c098c69731 req-03e8f8af-f5c7-420a-b991-61755622f61a service nova] Creating event network-changed:9f6689db-3748-44b1-8744-c649526fb091 for instance 798f4740-c14e-43e0-a02f-dba9d09efced on hv-cinder-85104 Jul 26 16:45:53.978084 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-bb7f4c83-0718-48b7-8085-d7c098c69731 req-03e8f8af-f5c7-420a-b991-61755622f61a service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037137 Jul 26 16:45:53.978944 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 574/1160] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:45:54.802888 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6426a610-78f9-4a48-bbac-16c8f5b25451 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:54.803587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-6426a610-78f9-4a48-bbac-16c8f5b25451 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:54.810447 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6426a610-78f9-4a48-bbac-16c8f5b25451 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:54.810898 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6426a610-78f9-4a48-bbac-16c8f5b25451 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:54.811686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6426a610-78f9-4a48-bbac-16c8f5b25451 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:54.812121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-6426a610-78f9-4a48-bbac-16c8f5b25451 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:54.950789 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-6426a610-78f9-4a48-bbac-16c8f5b25451 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:54.958146 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6426a610-78f9-4a48-bbac-16c8f5b25451 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1317 microversion: 2.1 time: 0.159359 Jul 26 16:45:54.958701 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 587/1161] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:54 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:55.976692 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:55.980782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a6ea6998-f6c7-404b-88b4-e7819111ef70 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:55.981475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a6ea6998-f6c7-404b-88b4-e7819111ef70 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:55.987539 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a6ea6998-f6c7-404b-88b4-e7819111ef70 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:55.987995 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a6ea6998-f6c7-404b-88b4-e7819111ef70 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:55.988813 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a6ea6998-f6c7-404b-88b4-e7819111ef70 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:55.989757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a6ea6998-f6c7-404b-88b4-e7819111ef70 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:56.118832 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a6ea6998-f6c7-404b-88b4-e7819111ef70 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:56.126190 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a6ea6998-f6c7-404b-88b4-e7819111ef70 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1317 microversion: 2.1 time: 0.150947 Jul 26 16:45:56.126757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 575/1162] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:55 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:57.147574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f73c8a68-c34b-4ce6-8176-ba9f8e242ca4 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:57.148183 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f73c8a68-c34b-4ce6-8176-ba9f8e242ca4 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:57.150062 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:57.151181 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=8 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:45:57.156001 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f73c8a68-c34b-4ce6-8176-ba9f8e242ca4 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:57.156475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f73c8a68-c34b-4ce6-8176-ba9f8e242ca4 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:57.157255 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f73c8a68-c34b-4ce6-8176-ba9f8e242ca4 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:57.157692 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f73c8a68-c34b-4ce6-8176-ba9f8e242ca4 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:57.285933 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f73c8a68-c34b-4ce6-8176-ba9f8e242ca4 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:57.294085 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f73c8a68-c34b-4ce6-8176-ba9f8e242ca4 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1317 microversion: 2.1 time: 0.150846 Jul 26 16:45:57.294699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 588/1163] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:57 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:58.314744 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7ecbb90a-d9f7-4981-b75f-006c0d327a95 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:58.315447 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7ecbb90a-d9f7-4981-b75f-006c0d327a95 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:58.322661 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7ecbb90a-d9f7-4981-b75f-006c0d327a95 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:58.323115 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7ecbb90a-d9f7-4981-b75f-006c0d327a95 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:58.323883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7ecbb90a-d9f7-4981-b75f-006c0d327a95 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:58.324318 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7ecbb90a-d9f7-4981-b75f-006c0d327a95 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:58.453956 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7ecbb90a-d9f7-4981-b75f-006c0d327a95 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:58.461968 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7ecbb90a-d9f7-4981-b75f-006c0d327a95 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1317 microversion: 2.1 time: 0.151413 Jul 26 16:45:58.462533 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 576/1164] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:58 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:45:59.482997 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-55a19880-5894-4a1e-bf6b-a0d9c76fc3be tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:45:59.483605 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-55a19880-5894-4a1e-bf6b-a0d9c76fc3be tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:45:59.490351 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-55a19880-5894-4a1e-bf6b-a0d9c76fc3be tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:59.490803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-55a19880-5894-4a1e-bf6b-a0d9c76fc3be tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:59.491567 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-55a19880-5894-4a1e-bf6b-a0d9c76fc3be tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:45:59.491999 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-55a19880-5894-4a1e-bf6b-a0d9c76fc3be tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:45:59.626581 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-55a19880-5894-4a1e-bf6b-a0d9c76fc3be tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:45:59.652910 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-55a19880-5894-4a1e-bf6b-a0d9c76fc3be tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1317 microversion: 2.1 time: 0.155488 Jul 26 16:45:59.652910 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 589/1165] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:45:59 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:46:00.670762 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cb4be27f-65d1-4e8c-9a3e-734608b58c93 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:46:00.671373 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cb4be27f-65d1-4e8c-9a3e-734608b58c93 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:46:00.677963 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cb4be27f-65d1-4e8c-9a3e-734608b58c93 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:00.678453 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cb4be27f-65d1-4e8c-9a3e-734608b58c93 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:00.679172 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cb4be27f-65d1-4e8c-9a3e-734608b58c93 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:00.679611 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cb4be27f-65d1-4e8c-9a3e-734608b58c93 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:00.808769 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cb4be27f-65d1-4e8c-9a3e-734608b58c93 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:46:00.816019 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cb4be27f-65d1-4e8c-9a3e-734608b58c93 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1317 microversion: 2.1 time: 0.149053 Jul 26 16:46:00.816605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 577/1166] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:46:00 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:46:01.301739 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-7d0ecb08-646a-4319-8e5a-539a87c709b5 req-82fe38ef-8ab0-4995-b948-e650416ee1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798f4740-c14e-43e0-a02f-dba9d09efced", "name": "network-vif-plugged", "status": "completed", "tag": "9f6689db-3748-44b1-8744-c649526fb091"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:46:01.311747 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-7d0ecb08-646a-4319-8e5a-539a87c709b5 req-82fe38ef-8ab0-4995-b948-e650416ee1c0 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:01.312098 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-7d0ecb08-646a-4319-8e5a-539a87c709b5 req-82fe38ef-8ab0-4995-b948-e650416ee1c0 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:01.323474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-7d0ecb08-646a-4319-8e5a-539a87c709b5 req-82fe38ef-8ab0-4995-b948-e650416ee1c0 service nova] Creating event network-vif-plugged:9f6689db-3748-44b1-8744-c649526fb091 for instance 798f4740-c14e-43e0-a02f-dba9d09efced on hv-cinder-85104 Jul 26 16:46:01.328549 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-7d0ecb08-646a-4319-8e5a-539a87c709b5 req-82fe38ef-8ab0-4995-b948-e650416ee1c0 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030472 Jul 26 16:46:01.329126 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 590/1167] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:46:01.584807 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:46:01.585015 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Tue Jul 26 16:46:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:46:01.843486 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-dbb97808-ca53-4009-82c6-338cf73be453 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:46:01.843486 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-dbb97808-ca53-4009-82c6-338cf73be453 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:46:01.844057 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dbb97808-ca53-4009-82c6-338cf73be453 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:01.844511 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dbb97808-ca53-4009-82c6-338cf73be453 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:01.845289 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dbb97808-ca53-4009-82c6-338cf73be453 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:01.845726 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-dbb97808-ca53-4009-82c6-338cf73be453 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:01.979154 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-dbb97808-ca53-4009-82c6-338cf73be453 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:46:01.986546 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-dbb97808-ca53-4009-82c6-338cf73be453 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1317 microversion: 2.1 time: 0.153439 Jul 26 16:46:01.987099 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 578/1168] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:46:01 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:46:03.008688 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-95cf3b12-310e-4c85-b437-950b174f6ffe tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:46:03.009290 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-95cf3b12-310e-4c85-b437-950b174f6ffe tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:46:03.015881 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95cf3b12-310e-4c85-b437-950b174f6ffe tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:03.016333 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95cf3b12-310e-4c85-b437-950b174f6ffe tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:03.017123 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95cf3b12-310e-4c85-b437-950b174f6ffe tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:03.017556 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95cf3b12-310e-4c85-b437-950b174f6ffe tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:03.155988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-95cf3b12-310e-4c85-b437-950b174f6ffe tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:46:03.163717 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-95cf3b12-310e-4c85-b437-950b174f6ffe tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1317 microversion: 2.1 time: 0.160329 Jul 26 16:46:03.164294 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 591/1169] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:46:03 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:46:04.184211 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8e036249-299b-4139-8047-bf3e8050a88b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:46:04.184882 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8e036249-299b-4139-8047-bf3e8050a88b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:46:04.191399 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e036249-299b-4139-8047-bf3e8050a88b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:04.191848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e036249-299b-4139-8047-bf3e8050a88b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:04.192645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e036249-299b-4139-8047-bf3e8050a88b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:04.193086 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e036249-299b-4139-8047-bf3e8050a88b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:04.324523 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8e036249-299b-4139-8047-bf3e8050a88b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:46:04.331857 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8e036249-299b-4139-8047-bf3e8050a88b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1501 microversion: 2.1 time: 0.151508 Jul 26 16:46:04.332428 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 579/1170] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:46:04 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:46:05.420781 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3c300a5e-b828-4ed7-ae11-d74c8cb43101 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:46:05.421860 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3c300a5e-b828-4ed7-ae11-d74c8cb43101 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:46:05.428363 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3c300a5e-b828-4ed7-ae11-d74c8cb43101 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:05.428843 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3c300a5e-b828-4ed7-ae11-d74c8cb43101 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:05.429805 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3c300a5e-b828-4ed7-ae11-d74c8cb43101 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:05.430247 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3c300a5e-b828-4ed7-ae11-d74c8cb43101 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:05.454461 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3c300a5e-b828-4ed7-ae11-d74c8cb43101 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Going to try to terminate instance {{(pid=124821) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:46:05.897121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3c300a5e-b828-4ed7-ae11-d74c8cb43101 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "DELETE /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 204 len: 0 microversion: 2.1 time: 0.479646 Jul 26 16:46:05.898671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 592/1171] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:46:05 2022] DELETE /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:46:05.906429 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3805b7dd-f722-4515-b9b0-b551a0cc5c01 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:46:05.907030 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3805b7dd-f722-4515-b9b0-b551a0cc5c01 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:46:05.913729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3805b7dd-f722-4515-b9b0-b551a0cc5c01 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:05.914168 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3805b7dd-f722-4515-b9b0-b551a0cc5c01 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:05.914917 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3805b7dd-f722-4515-b9b0-b551a0cc5c01 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:05.915344 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3805b7dd-f722-4515-b9b0-b551a0cc5c01 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:06.056851 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3805b7dd-f722-4515-b9b0-b551a0cc5c01 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:46:06.064236 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3805b7dd-f722-4515-b9b0-b551a0cc5c01 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1507 microversion: 2.1 time: 0.161585 Jul 26 16:46:06.064811 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 580/1172] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:46:05 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:46:07.086656 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-e436367a-043e-4aec-adc4-7689a842fe24 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:46:07.087363 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-e436367a-043e-4aec-adc4-7689a842fe24 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:46:07.093986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e436367a-043e-4aec-adc4-7689a842fe24 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:07.094421 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e436367a-043e-4aec-adc4-7689a842fe24 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:07.095215 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e436367a-043e-4aec-adc4-7689a842fe24 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:07.095653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-e436367a-043e-4aec-adc4-7689a842fe24 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:07.231917 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-e436367a-043e-4aec-adc4-7689a842fe24 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:46:07.239384 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-e436367a-043e-4aec-adc4-7689a842fe24 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1507 microversion: 2.1 time: 0.157722 Jul 26 16:46:07.239947 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 593/1173] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:46:07 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:46:08.045304 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-ad79bdb3-302e-41f4-adc7-befea5939f61 req-8b4e08ee-43da-4564-83b5-7cf4b913b81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "798f4740-c14e-43e0-a02f-dba9d09efced", "name": "network-vif-deleted", "tag": "9f6689db-3748-44b1-8744-c649526fb091"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:46:08.050745 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:46:08.056520 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-ad79bdb3-302e-41f4-adc7-befea5939f61 req-8b4e08ee-43da-4564-83b5-7cf4b913b81e service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:08.059449 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-ad79bdb3-302e-41f4-adc7-befea5939f61 req-8b4e08ee-43da-4564-83b5-7cf4b913b81e service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:08.067932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-ad79bdb3-302e-41f4-adc7-befea5939f61 req-8b4e08ee-43da-4564-83b5-7cf4b913b81e service nova] Creating event network-vif-deleted:9f6689db-3748-44b1-8744-c649526fb091 for instance 798f4740-c14e-43e0-a02f-dba9d09efced on hv-cinder-85104 Jul 26 16:46:08.072886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-ad79bdb3-302e-41f4-adc7-befea5939f61 req-8b4e08ee-43da-4564-83b5-7cf4b913b81e service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031309 Jul 26 16:46:08.073480 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 581/1174] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:46:08.259072 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dcdbd3fa-a440-421a-97b0-236d0627bb0b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:46:08.259736 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-dcdbd3fa-a440-421a-97b0-236d0627bb0b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:46:08.266921 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dcdbd3fa-a440-421a-97b0-236d0627bb0b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:08.267373 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dcdbd3fa-a440-421a-97b0-236d0627bb0b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:08.268146 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dcdbd3fa-a440-421a-97b0-236d0627bb0b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:08.268620 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-dcdbd3fa-a440-421a-97b0-236d0627bb0b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:08.333946 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-dcdbd3fa-a440-421a-97b0-236d0627bb0b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c505966b4041788a1efee66df8444f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '319ddb5f712b4c8aa6fdaa01e62674f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:46:08.342021 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dcdbd3fa-a440-421a-97b0-236d0627bb0b tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 200 len: 1302 microversion: 2.1 time: 0.086838 Jul 26 16:46:08.342587 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 594/1175] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:46:08 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:46:09.364742 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3ead8d62-ab1a-453c-9ddd-b4c93a30b3b6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:46:09.365445 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3ead8d62-ab1a-453c-9ddd-b4c93a30b3b6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] [instance: 798f4740-c14e-43e0-a02f-dba9d09efced] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:46:09.372935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3ead8d62-ab1a-453c-9ddd-b4c93a30b3b6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:09.373419 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3ead8d62-ab1a-453c-9ddd-b4c93a30b3b6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:09.374389 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3ead8d62-ab1a-453c-9ddd-b4c93a30b3b6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:46:09.374832 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3ead8d62-ab1a-453c-9ddd-b4c93a30b3b6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-3ead8d62-ab1a-453c-9ddd-b4c93a30b3b6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] HTTP exception thrown: Instance 798f4740-c14e-43e0-a02f-dba9d09efced could not be found. Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3ead8d62-ab1a-453c-9ddd-b4c93a30b3b6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Request method failure captured: Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced HTTP/1.1 Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BoY5v2FJ9tMrrBUgUHGu2yeww0cUg4NDrDAPYqkm0MGz-JCfrplliyoqvsAbRY0Fvj1QyjBB09X9x9Sb0FydLnJZdeCUStab6n4OQrEq7_bBjMxbn71dIS03xxSRFQ17mlO1HnaNi4dVl7iHBY3ikwfOatw_eNFU_1P6fhESxZ-VwE Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 319ddb5f712b4c8aa6fdaa01e62674f0 Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-VolumesActionsTest-1155833300 Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:46:09.390577 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/319ddb5f712b4c8aa6fdaa01e62674f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/319ddb5f712b4c8aa6fdaa01e62674f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/319ddb5f712b4c8aa6fdaa01e62674f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_319ddb5f712b4c8aa6fdaa01e62674f0", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-VolumesActionsTest-1155833300 Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 319ddb5f712b4c8aa6fdaa01e62674f0 Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-VolumesActionsTest-1155833300 Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-VolumesActionsTest-1155833300-project Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: 47c505966b4041788a1efee66df8444f Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-VolumesActionsTest-1155833300-project Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 798f4740-c14e-43e0-a02f-dba9d09efced could not be found. Jul 26 16:46:09.392348 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '798f4740-c14e-43e0-a02f-dba9d09efced'} Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 798f4740-c14e-43e0-a02f-dba9d09efced could not be found. Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:46:09.393327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 798f4740-c14e-43e0-a02f-dba9d09efced could not be found. Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 798f4740-c14e-43e0-a02f-dba9d09efced could not be found. Jul 26 16:46:09.395093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:46:09.396629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3ead8d62-ab1a-453c-9ddd-b4c93a30b3b6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] Returning 404 to user: Instance 798f4740-c14e-43e0-a02f-dba9d09efced could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:46:09.396629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3ead8d62-ab1a-453c-9ddd-b4c93a30b3b6 tempest-VolumesActionsTest-1155833300 tempest-VolumesActionsTest-1155833300-project] 10.222.0.144 "GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced" status: 404 len: 111 microversion: 2.1 time: 0.032140 Jul 26 16:46:09.396629 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 582/1176] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:46:09 2022] GET /compute/v2.1/servers/798f4740-c14e-43e0-a02f-dba9d09efced => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:47:03.249772 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7f211472-4599-4bdd-8523-4e2ee5484327 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:03.250336 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7f211472-4599-4bdd-8523-4e2ee5484327 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:03.252641 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:47:03.253337 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:47:03.258212 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f211472-4599-4bdd-8523-4e2ee5484327 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:03.258667 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f211472-4599-4bdd-8523-4e2ee5484327 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:03.259432 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f211472-4599-4bdd-8523-4e2ee5484327 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:03.259873 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f211472-4599-4bdd-8523-4e2ee5484327 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:03.284228 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7f211472-4599-4bdd-8523-4e2ee5484327 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Going to try to terminate instance {{(pid=124821) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:47:03.716223 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7f211472-4599-4bdd-8523-4e2ee5484327 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "DELETE /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 204 len: 0 microversion: 2.1 time: 0.470129 Jul 26 16:47:03.716839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 595/1177] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:47:03 2022] DELETE /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:47:03.725336 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-57203b0d-9bb6-4823-b48a-dac14722d705 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:03.729254 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-57203b0d-9bb6-4823-b48a-dac14722d705 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:03.729254 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=70 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:47:03.733355 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57203b0d-9bb6-4823-b48a-dac14722d705 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:03.733801 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57203b0d-9bb6-4823-b48a-dac14722d705 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:03.734557 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57203b0d-9bb6-4823-b48a-dac14722d705 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:03.735015 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57203b0d-9bb6-4823-b48a-dac14722d705 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:03.865650 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-57203b0d-9bb6-4823-b48a-dac14722d705 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:03.873145 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-57203b0d-9bb6-4823-b48a-dac14722d705 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1580 microversion: 2.1 time: 0.151998 Jul 26 16:47:03.873693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 583/1178] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:03 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1580 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:04.895358 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3cc6a7a2-0561-491f-892c-c394dc9a3d09 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:04.896134 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3cc6a7a2-0561-491f-892c-c394dc9a3d09 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:04.902633 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3cc6a7a2-0561-491f-892c-c394dc9a3d09 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:04.903078 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3cc6a7a2-0561-491f-892c-c394dc9a3d09 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:04.903835 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3cc6a7a2-0561-491f-892c-c394dc9a3d09 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:04.904266 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3cc6a7a2-0561-491f-892c-c394dc9a3d09 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:05.033936 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3cc6a7a2-0561-491f-892c-c394dc9a3d09 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:05.042058 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3cc6a7a2-0561-491f-892c-c394dc9a3d09 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1580 microversion: 2.1 time: 0.151174 Jul 26 16:47:05.044537 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 596/1179] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:04 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1580 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:06.063052 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4cf77a19-44a5-44c9-bb86-e528cc768f34 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:06.063674 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4cf77a19-44a5-44c9-bb86-e528cc768f34 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:06.071362 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4cf77a19-44a5-44c9-bb86-e528cc768f34 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:06.071819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4cf77a19-44a5-44c9-bb86-e528cc768f34 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:06.072620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4cf77a19-44a5-44c9-bb86-e528cc768f34 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:06.073063 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4cf77a19-44a5-44c9-bb86-e528cc768f34 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:06.206722 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-4cf77a19-44a5-44c9-bb86-e528cc768f34 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:06.217460 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4cf77a19-44a5-44c9-bb86-e528cc768f34 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1580 microversion: 2.1 time: 0.158206 Jul 26 16:47:06.218317 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 584/1180] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:06 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1580 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:07.216325 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-86ff4fff-4a0f-4053-81a1-0695bc841ed1 req-4c91a394-10e2-4632-b573-383cb8913e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608fc7e4-4ccf-4823-82af-392b80004b29", "name": "network-vif-deleted", "tag": "e4318fe5-e428-4abb-b479-2d426846b89d"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:47:07.226199 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-86ff4fff-4a0f-4053-81a1-0695bc841ed1 req-4c91a394-10e2-4632-b573-383cb8913e8f service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:07.226651 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-86ff4fff-4a0f-4053-81a1-0695bc841ed1 req-4c91a394-10e2-4632-b573-383cb8913e8f service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:07.237922 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-86ff4fff-4a0f-4053-81a1-0695bc841ed1 req-4c91a394-10e2-4632-b573-383cb8913e8f service nova] Creating event network-vif-deleted:e4318fe5-e428-4abb-b479-2d426846b89d for instance 608fc7e4-4ccf-4823-82af-392b80004b29 on hv-cinder-85104 Jul 26 16:47:07.239956 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-a370a16f-9d3c-4a81-aed1-eb96a50edf26 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:07.240602 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-a370a16f-9d3c-4a81-aed1-eb96a50edf26 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:07.243270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-86ff4fff-4a0f-4053-81a1-0695bc841ed1 req-4c91a394-10e2-4632-b573-383cb8913e8f service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030925 Jul 26 16:47:07.243819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 597/1181] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:47:07.249282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a370a16f-9d3c-4a81-aed1-eb96a50edf26 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:07.252188 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a370a16f-9d3c-4a81-aed1-eb96a50edf26 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:07.254303 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a370a16f-9d3c-4a81-aed1-eb96a50edf26 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:07.255432 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-a370a16f-9d3c-4a81-aed1-eb96a50edf26 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:07.321462 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-a370a16f-9d3c-4a81-aed1-eb96a50edf26 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:07.329085 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-a370a16f-9d3c-4a81-aed1-eb96a50edf26 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1512 microversion: 2.1 time: 0.093760 Jul 26 16:47:07.329678 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 585/1182] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:07 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:47:08.352197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:08.353199 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:08.359452 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:08.361766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:08.361766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:08.361766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:08.393298 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:08.393738 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:08.394198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lazy-loading 'fault' on Instance uuid 608fc7e4-4ccf-4823-82af-392b80004b29 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:47:08.439619 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:08.448748 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3b99b0de-3dd1-4037-bd9d-43e9315ebe72 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 200 len: 1233 microversion: 2.1 time: 0.101129 Jul 26 16:47:08.462278 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 598/1183] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:08 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 1233 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:09.474142 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5d4ba6e9-d110-49f8-ac84-22dfce80d402 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:09.474880 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5d4ba6e9-d110-49f8-ac84-22dfce80d402 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:09.481462 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5d4ba6e9-d110-49f8-ac84-22dfce80d402 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:09.481897 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5d4ba6e9-d110-49f8-ac84-22dfce80d402 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:09.482659 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5d4ba6e9-d110-49f8-ac84-22dfce80d402 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:09.483101 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5d4ba6e9-d110-49f8-ac84-22dfce80d402 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:09.496830 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-5d4ba6e9-d110-49f8-ac84-22dfce80d402 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] HTTP exception thrown: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5d4ba6e9-d110-49f8-ac84-22dfce80d402 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Request method failure captured: Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 HTTP/1.1 Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BlZvxVrb4OfRcJkWMTX19c9_7gPhzahY1kGdUs26uuEVFoIYeeKz5kGOgO2MdpUgL8OGkryzPn9Evs-OYjcEL6-Q3J0hWYj6-1dq4V-JttY1pNZHmAlt4sABEPGBhxLkrVpqX0zkWZbyMwMhUEU8oLSire629LQ8UMsTGltH8votx0 Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 94684df47fe14e55af2e72ab5d2ddc48 Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-TestVolumeBootPattern-165332593 Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:47:09.498365 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_94684df47fe14e55af2e72ab5d2ddc48", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-TestVolumeBootPattern-165332593 Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 94684df47fe14e55af2e72ab5d2ddc48 Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-TestVolumeBootPattern-165332593 Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-TestVolumeBootPattern-165332593-project Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: ea4ccbb465094f079dcc4ca3bcac59cb Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-TestVolumeBootPattern-165332593-project Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:47:09.500117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '608fc7e4-4ccf-4823-82af-392b80004b29'} Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:47:09.501393 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:47:09.503027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:47:09.504505 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5d4ba6e9-d110-49f8-ac84-22dfce80d402 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Returning 404 to user: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:47:09.504505 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5d4ba6e9-d110-49f8-ac84-22dfce80d402 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 404 len: 111 microversion: 2.1 time: 0.030146 Jul 26 16:47:09.504505 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 586/1184] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:09 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:47:09.597491 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1495270663", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-828638125", "security_groups": [{"name": "tempest-secgroup-smoke-1873328593"}], "block_device_mapping_v2": [{"uuid": "c5bad96c-a83d-493f-a673-c1b9efc30de5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f248d137-b4b6-4a4b-82ad-d9d4bbbe5d97"}]}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:47:09.711040 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.network.neutron [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] validate_networks() for [('f248d137-b4b6-4a4b-82ad-d9d4bbbe5d97', None, None, None, None, None)] {{(pid=124821) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:47:10.152775 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Flavor limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:47:10.152775 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Image limits 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:47:10.152998 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Flavor pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:47:10.153369 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Image pref 0:0:0 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:47:10.153784 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.virt.hardware [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124821) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:47:10.163653 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:10.164109 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:10.164940 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:10.165375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:10.182198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Getting quotas for project 94684df47fe14e55af2e72ab5d2ddc48. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:47:10.186125 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Getting quotas for user ea4ccbb465094f079dcc4ca3bcac59cb and project 94684df47fe14e55af2e72ab5d2ddc48. Resources: {'instances', 'cores', 'ram'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:47:10.440818 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Going to run 1 instances... {{(pid=124821) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:47:10.443451 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5bad96c-a83d-493f-a673-c1b9efc30de5',volume_size=None,volume_type=None)] {{(pid=124821) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:47:11.170131 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c7f6804f-7459-453f-94d0-4e77bcfd0599 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.576350 Jul 26 16:47:11.170779 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 599/1185] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:47:09 2022] POST /compute/v2.1/servers => generated 408 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:47:11.181951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-de890dcd-4401-4b51-913c-a1fa428765cd tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:11.182559 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-de890dcd-4401-4b51-913c-a1fa428765cd tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:11.239958 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-de890dcd-4401-4b51-913c-a1fa428765cd tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:11.244176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-de890dcd-4401-4b51-913c-a1fa428765cd tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1097 microversion: 2.1 time: 0.066110 Jul 26 16:47:11.244900 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 587/1186] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:11 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1097 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:12.265921 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f2163e2f-ed03-471b-b3e6-5dfec328c812 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:12.266643 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f2163e2f-ed03-471b-b3e6-5dfec328c812 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:12.274356 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f2163e2f-ed03-471b-b3e6-5dfec328c812 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:12.274891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f2163e2f-ed03-471b-b3e6-5dfec328c812 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:12.275711 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f2163e2f-ed03-471b-b3e6-5dfec328c812 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:12.276156 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f2163e2f-ed03-471b-b3e6-5dfec328c812 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:12.341824 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f2163e2f-ed03-471b-b3e6-5dfec328c812 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:12.349783 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f2163e2f-ed03-471b-b3e6-5dfec328c812 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1147 microversion: 2.1 time: 0.088276 Jul 26 16:47:12.350339 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 600/1187] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:12 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1147 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:13.370140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-81194171-4e64-487f-9858-ba3e3b5a8652 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:13.370751 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-81194171-4e64-487f-9858-ba3e3b5a8652 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:13.378392 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-81194171-4e64-487f-9858-ba3e3b5a8652 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:13.378791 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-81194171-4e64-487f-9858-ba3e3b5a8652 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:13.380051 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-81194171-4e64-487f-9858-ba3e3b5a8652 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:13.380517 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-81194171-4e64-487f-9858-ba3e3b5a8652 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:13.443908 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-81194171-4e64-487f-9858-ba3e3b5a8652 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:13.451679 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-81194171-4e64-487f-9858-ba3e3b5a8652 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1147 microversion: 2.1 time: 0.085340 Jul 26 16:47:13.452605 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 588/1188] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:13 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1147 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:14.473072 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f1e456dd-dcf1-438d-a13c-f4f5e955d6a3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:14.473824 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f1e456dd-dcf1-438d-a13c-f4f5e955d6a3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:14.480440 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f1e456dd-dcf1-438d-a13c-f4f5e955d6a3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:14.480894 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f1e456dd-dcf1-438d-a13c-f4f5e955d6a3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:14.481656 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f1e456dd-dcf1-438d-a13c-f4f5e955d6a3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:14.482091 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f1e456dd-dcf1-438d-a13c-f4f5e955d6a3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:14.542322 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f1e456dd-dcf1-438d-a13c-f4f5e955d6a3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:14.549760 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f1e456dd-dcf1-438d-a13c-f4f5e955d6a3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1147 microversion: 2.1 time: 0.080636 Jul 26 16:47:14.550491 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 601/1189] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:14 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1147 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:15.571808 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-94439045-081a-4e92-88b8-63e38fc228ae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:15.572575 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-94439045-081a-4e92-88b8-63e38fc228ae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:15.578955 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94439045-081a-4e92-88b8-63e38fc228ae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:15.579399 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94439045-081a-4e92-88b8-63e38fc228ae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:15.580167 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94439045-081a-4e92-88b8-63e38fc228ae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:15.580654 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94439045-081a-4e92-88b8-63e38fc228ae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:15.657693 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-94439045-081a-4e92-88b8-63e38fc228ae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:15.665494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-94439045-081a-4e92-88b8-63e38fc228ae tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1195 microversion: 2.1 time: 0.098313 Jul 26 16:47:15.666053 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 589/1190] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:15 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1195 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:16.687448 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8e072893-bb37-4315-9e84-1351f4ed2971 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:16.690390 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8e072893-bb37-4315-9e84-1351f4ed2971 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:16.695712 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8e072893-bb37-4315-9e84-1351f4ed2971 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:16.696184 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8e072893-bb37-4315-9e84-1351f4ed2971 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:16.696948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8e072893-bb37-4315-9e84-1351f4ed2971 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:16.697379 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8e072893-bb37-4315-9e84-1351f4ed2971 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:16.765120 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8e072893-bb37-4315-9e84-1351f4ed2971 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:16.772630 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8e072893-bb37-4315-9e84-1351f4ed2971 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1213 microversion: 2.1 time: 0.089615 Jul 26 16:47:16.773186 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 602/1191] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:16 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:17.793458 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1897cc6d-c6ff-4f45-baa2-fee960ce9854 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:17.794186 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1897cc6d-c6ff-4f45-baa2-fee960ce9854 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:17.800726 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1897cc6d-c6ff-4f45-baa2-fee960ce9854 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:17.803489 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1897cc6d-c6ff-4f45-baa2-fee960ce9854 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:17.803489 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1897cc6d-c6ff-4f45-baa2-fee960ce9854 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:17.803489 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1897cc6d-c6ff-4f45-baa2-fee960ce9854 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:17.941584 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1897cc6d-c6ff-4f45-baa2-fee960ce9854 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:17.949788 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-628c4d20-07f6-4393-9581-63a01093a921 req-920e7486-14c5-4024-ba61-cb4d159aa3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f07c88-96f8-48c2-8523-be0e7981ee79", "tag": "ebc7fc3d-47c6-4726-9b7f-a4a4e8468fe2"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:47:17.962506 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1897cc6d-c6ff-4f45-baa2-fee960ce9854 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1281 microversion: 2.1 time: 0.172398 Jul 26 16:47:17.963764 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 590/1192] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:17 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1281 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:17.971042 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-628c4d20-07f6-4393-9581-63a01093a921 req-920e7486-14c5-4024-ba61-cb4d159aa3d9 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:17.971483 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-628c4d20-07f6-4393-9581-63a01093a921 req-920e7486-14c5-4024-ba61-cb4d159aa3d9 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:17.988839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-628c4d20-07f6-4393-9581-63a01093a921 req-920e7486-14c5-4024-ba61-cb4d159aa3d9 service nova] Creating event network-changed:ebc7fc3d-47c6-4726-9b7f-a4a4e8468fe2 for instance e9f07c88-96f8-48c2-8523-be0e7981ee79 on hv-cinder-85104 Jul 26 16:47:18.005641 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-628c4d20-07f6-4393-9581-63a01093a921 req-920e7486-14c5-4024-ba61-cb4d159aa3d9 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059691 Jul 26 16:47:18.011127 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 603/1193] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:47:18.983619 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-57d62c72-c9da-4f8b-aab0-05af726a9f53 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:18.984281 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-57d62c72-c9da-4f8b-aab0-05af726a9f53 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:18.991282 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57d62c72-c9da-4f8b-aab0-05af726a9f53 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:18.991734 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57d62c72-c9da-4f8b-aab0-05af726a9f53 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:18.992538 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57d62c72-c9da-4f8b-aab0-05af726a9f53 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:18.992982 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-57d62c72-c9da-4f8b-aab0-05af726a9f53 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:19.389110 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-57d62c72-c9da-4f8b-aab0-05af726a9f53 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:19.397157 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-57d62c72-c9da-4f8b-aab0-05af726a9f53 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1281 microversion: 2.1 time: 0.417368 Jul 26 16:47:19.397720 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 591/1194] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:18 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1281 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:20.415829 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:47:20.416628 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=6 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:47:20.420689 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-cadc9e0d-52e9-4e29-a615-8878b7f35193 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:20.421383 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-cadc9e0d-52e9-4e29-a615-8878b7f35193 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:20.427444 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cadc9e0d-52e9-4e29-a615-8878b7f35193 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:20.427899 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cadc9e0d-52e9-4e29-a615-8878b7f35193 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:20.428691 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cadc9e0d-52e9-4e29-a615-8878b7f35193 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:20.429128 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-cadc9e0d-52e9-4e29-a615-8878b7f35193 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:20.562375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-cadc9e0d-52e9-4e29-a615-8878b7f35193 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:20.570333 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-cadc9e0d-52e9-4e29-a615-8878b7f35193 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1281 microversion: 2.1 time: 0.155785 Jul 26 16:47:20.571223 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 604/1195] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:20 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:21.591299 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-073c9fe9-68d0-460d-aa22-99774430f0aa tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:21.591840 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-073c9fe9-68d0-460d-aa22-99774430f0aa tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:21.593742 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:47:21.598557 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-073c9fe9-68d0-460d-aa22-99774430f0aa tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:21.599012 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-073c9fe9-68d0-460d-aa22-99774430f0aa tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:21.599777 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-073c9fe9-68d0-460d-aa22-99774430f0aa tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:21.600217 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-073c9fe9-68d0-460d-aa22-99774430f0aa tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:21.740113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-073c9fe9-68d0-460d-aa22-99774430f0aa tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:21.747734 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-073c9fe9-68d0-460d-aa22-99774430f0aa tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.160573 Jul 26 16:47:21.748765 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 592/1196] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:21 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:22.770546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f8623a8d-0ee2-4747-86c9-6905585c3aa6 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:22.771165 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f8623a8d-0ee2-4747-86c9-6905585c3aa6 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:22.777680 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8623a8d-0ee2-4747-86c9-6905585c3aa6 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:22.778129 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8623a8d-0ee2-4747-86c9-6905585c3aa6 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:22.778889 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8623a8d-0ee2-4747-86c9-6905585c3aa6 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:22.779323 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8623a8d-0ee2-4747-86c9-6905585c3aa6 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:22.911298 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f8623a8d-0ee2-4747-86c9-6905585c3aa6 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:22.918709 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f8623a8d-0ee2-4747-86c9-6905585c3aa6 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.152611 Jul 26 16:47:22.919535 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 605/1197] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:22 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:23.939684 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-0acd57b2-5fef-4d49-a68a-0d2ae3cb2547 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:23.940224 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-0acd57b2-5fef-4d49-a68a-0d2ae3cb2547 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:23.947120 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0acd57b2-5fef-4d49-a68a-0d2ae3cb2547 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:23.947568 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0acd57b2-5fef-4d49-a68a-0d2ae3cb2547 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:23.948323 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0acd57b2-5fef-4d49-a68a-0d2ae3cb2547 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:23.948781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-0acd57b2-5fef-4d49-a68a-0d2ae3cb2547 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:24.092240 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-0acd57b2-5fef-4d49-a68a-0d2ae3cb2547 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:24.099944 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-0acd57b2-5fef-4d49-a68a-0d2ae3cb2547 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.164183 Jul 26 16:47:24.100522 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 593/1198] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:23 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:25.121675 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7f37d1be-9977-44b0-9bd3-40a78cd556a4 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:25.122354 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7f37d1be-9977-44b0-9bd3-40a78cd556a4 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:25.128839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f37d1be-9977-44b0-9bd3-40a78cd556a4 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:25.129287 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f37d1be-9977-44b0-9bd3-40a78cd556a4 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:25.130052 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f37d1be-9977-44b0-9bd3-40a78cd556a4 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:25.130481 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7f37d1be-9977-44b0-9bd3-40a78cd556a4 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:25.265978 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7f37d1be-9977-44b0-9bd3-40a78cd556a4 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:25.274501 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7f37d1be-9977-44b0-9bd3-40a78cd556a4 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.156408 Jul 26 16:47:25.277069 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 606/1199] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:25 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:26.296991 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-69a94947-efbf-4f46-a935-8f7f5b0d8562 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:26.297614 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-69a94947-efbf-4f46-a935-8f7f5b0d8562 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:26.304544 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69a94947-efbf-4f46-a935-8f7f5b0d8562 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:26.305002 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69a94947-efbf-4f46-a935-8f7f5b0d8562 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:26.305778 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69a94947-efbf-4f46-a935-8f7f5b0d8562 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:26.306252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-69a94947-efbf-4f46-a935-8f7f5b0d8562 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:26.435575 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-69a94947-efbf-4f46-a935-8f7f5b0d8562 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:26.443206 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-69a94947-efbf-4f46-a935-8f7f5b0d8562 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.150088 Jul 26 16:47:26.443777 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 594/1200] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:26 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:27.464448 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2fc14c87-76ee-4cf6-9a10-002199d7e789 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:27.464979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2fc14c87-76ee-4cf6-9a10-002199d7e789 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:27.471428 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2fc14c87-76ee-4cf6-9a10-002199d7e789 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:27.471875 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2fc14c87-76ee-4cf6-9a10-002199d7e789 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:27.472655 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2fc14c87-76ee-4cf6-9a10-002199d7e789 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:27.473089 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2fc14c87-76ee-4cf6-9a10-002199d7e789 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:27.607861 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2fc14c87-76ee-4cf6-9a10-002199d7e789 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:27.615264 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2fc14c87-76ee-4cf6-9a10-002199d7e789 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.154717 Jul 26 16:47:27.615911 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 607/1201] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:27 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:28.637383 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-914f564e-f2b1-4cb0-81ed-329a4a783299 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:28.638000 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-914f564e-f2b1-4cb0-81ed-329a4a783299 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:28.644556 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-914f564e-f2b1-4cb0-81ed-329a4a783299 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:28.645010 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-914f564e-f2b1-4cb0-81ed-329a4a783299 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:28.645770 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-914f564e-f2b1-4cb0-81ed-329a4a783299 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:28.646300 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-914f564e-f2b1-4cb0-81ed-329a4a783299 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:28.824090 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-914f564e-f2b1-4cb0-81ed-329a4a783299 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:28.831471 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-914f564e-f2b1-4cb0-81ed-329a4a783299 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.198845 Jul 26 16:47:28.832029 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 595/1202] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:28 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:29.852778 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a93900fb-c1cc-4a05-85c0-ac6014409f68 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:29.853987 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a93900fb-c1cc-4a05-85c0-ac6014409f68 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:29.860120 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a93900fb-c1cc-4a05-85c0-ac6014409f68 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:29.860606 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a93900fb-c1cc-4a05-85c0-ac6014409f68 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:29.861370 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a93900fb-c1cc-4a05-85c0-ac6014409f68 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:29.861805 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a93900fb-c1cc-4a05-85c0-ac6014409f68 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:29.994215 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a93900fb-c1cc-4a05-85c0-ac6014409f68 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:30.001584 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a93900fb-c1cc-4a05-85c0-ac6014409f68 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.153314 Jul 26 16:47:30.002144 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 608/1203] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:29 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:31.022374 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9a1e47ae-9d49-4c86-9b03-8e6cbc1b7b85 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:31.023095 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9a1e47ae-9d49-4c86-9b03-8e6cbc1b7b85 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:31.029831 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9a1e47ae-9d49-4c86-9b03-8e6cbc1b7b85 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:31.030372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9a1e47ae-9d49-4c86-9b03-8e6cbc1b7b85 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:31.031227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9a1e47ae-9d49-4c86-9b03-8e6cbc1b7b85 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:31.031742 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9a1e47ae-9d49-4c86-9b03-8e6cbc1b7b85 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:31.203902 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9a1e47ae-9d49-4c86-9b03-8e6cbc1b7b85 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:31.211898 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9a1e47ae-9d49-4c86-9b03-8e6cbc1b7b85 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.193662 Jul 26 16:47:31.212473 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 596/1204] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:31 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:32.232658 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-afa69aad-898d-4215-9f2b-23f9b4070804 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:32.233275 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-afa69aad-898d-4215-9f2b-23f9b4070804 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:32.239899 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-afa69aad-898d-4215-9f2b-23f9b4070804 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:32.240334 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-afa69aad-898d-4215-9f2b-23f9b4070804 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:32.241129 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-afa69aad-898d-4215-9f2b-23f9b4070804 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:32.241564 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-afa69aad-898d-4215-9f2b-23f9b4070804 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:32.408827 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-afa69aad-898d-4215-9f2b-23f9b4070804 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:32.417677 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-afa69aad-898d-4215-9f2b-23f9b4070804 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.189126 Jul 26 16:47:32.418345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 609/1205] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:32 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:33.443411 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-63f5018a-2583-4216-bdcb-6fd94fd6a3fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:33.444551 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-63f5018a-2583-4216-bdcb-6fd94fd6a3fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:33.454048 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-63f5018a-2583-4216-bdcb-6fd94fd6a3fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:33.454938 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-63f5018a-2583-4216-bdcb-6fd94fd6a3fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:33.456122 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-63f5018a-2583-4216-bdcb-6fd94fd6a3fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:33.456809 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-63f5018a-2583-4216-bdcb-6fd94fd6a3fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:33.645601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-4984b836-c9c3-4cb8-b900-cd2eb8960180 req-87435e6d-68cb-4766-b8bb-fadd2c983d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f07c88-96f8-48c2-8523-be0e7981ee79", "name": "network-vif-plugged", "status": "completed", "tag": "ebc7fc3d-47c6-4726-9b7f-a4a4e8468fe2"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:47:33.650999 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:47:33.658118 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-4984b836-c9c3-4cb8-b900-cd2eb8960180 req-87435e6d-68cb-4766-b8bb-fadd2c983d1a service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:33.658789 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-4984b836-c9c3-4cb8-b900-cd2eb8960180 req-87435e6d-68cb-4766-b8bb-fadd2c983d1a service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:33.678435 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-4984b836-c9c3-4cb8-b900-cd2eb8960180 req-87435e6d-68cb-4766-b8bb-fadd2c983d1a service nova] Creating event network-vif-plugged:ebc7fc3d-47c6-4726-9b7f-a4a4e8468fe2 for instance e9f07c88-96f8-48c2-8523-be0e7981ee79 on hv-cinder-85104 Jul 26 16:47:33.684426 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-4984b836-c9c3-4cb8-b900-cd2eb8960180 req-87435e6d-68cb-4766-b8bb-fadd2c983d1a service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042587 Jul 26 16:47:33.685648 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 610/1206] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:47:33.846987 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-63f5018a-2583-4216-bdcb-6fd94fd6a3fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:33.856275 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-63f5018a-2583-4216-bdcb-6fd94fd6a3fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.419103 Jul 26 16:47:33.856879 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 597/1207] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:33 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:34.877555 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f8a6dd7a-d1a8-4246-9514-c03e542d3a45 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:34.878310 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f8a6dd7a-d1a8-4246-9514-c03e542d3a45 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:34.885957 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8a6dd7a-d1a8-4246-9514-c03e542d3a45 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:34.886402 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8a6dd7a-d1a8-4246-9514-c03e542d3a45 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:34.887205 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8a6dd7a-d1a8-4246-9514-c03e542d3a45 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:34.887683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f8a6dd7a-d1a8-4246-9514-c03e542d3a45 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:34.902978 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:47:35.179784 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f8a6dd7a-d1a8-4246-9514-c03e542d3a45 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:35.187904 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f8a6dd7a-d1a8-4246-9514-c03e542d3a45 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1269 microversion: 2.1 time: 0.315205 Jul 26 16:47:35.188486 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 611/1208] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:34 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1269 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:36.208465 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-07c6a3dc-5d36-413d-8b23-8a7b89595673 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:36.209060 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-07c6a3dc-5d36-413d-8b23-8a7b89595673 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:36.211408 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=36 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:47:36.216118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-07c6a3dc-5d36-413d-8b23-8a7b89595673 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:36.216603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-07c6a3dc-5d36-413d-8b23-8a7b89595673 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:36.217376 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-07c6a3dc-5d36-413d-8b23-8a7b89595673 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:36.217808 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-07c6a3dc-5d36-413d-8b23-8a7b89595673 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:36.222368 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=81 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:47:36.347246 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-07c6a3dc-5d36-413d-8b23-8a7b89595673 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:36.355112 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-07c6a3dc-5d36-413d-8b23-8a7b89595673 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1457 microversion: 2.1 time: 0.150289 Jul 26 16:47:36.355690 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 598/1209] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:36 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1457 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:36.377067 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-955e9aa8-e912-4fb4-b6f0-a8815c625b28 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:47:36.377901 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-955e9aa8-e912-4fb4-b6f0-a8815c625b28 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:47:36.385269 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-955e9aa8-e912-4fb4-b6f0-a8815c625b28 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:36.385728 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-955e9aa8-e912-4fb4-b6f0-a8815c625b28 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:36.386503 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-955e9aa8-e912-4fb4-b6f0-a8815c625b28 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:36.386941 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-955e9aa8-e912-4fb4-b6f0-a8815c625b28 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:36.520211 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-955e9aa8-e912-4fb4-b6f0-a8815c625b28 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:47:36.527681 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-955e9aa8-e912-4fb4-b6f0-a8815c625b28 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1457 microversion: 2.1 time: 0.155772 Jul 26 16:47:36.528244 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 612/1210] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:47:36 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1457 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:47:38.979042 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-8d49c32e-aef3-48c9-b419-2896edb47aec req-81fd910a-0259-4f9c-b738-522a653aa736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f07c88-96f8-48c2-8523-be0e7981ee79", "tag": "ebc7fc3d-47c6-4726-9b7f-a4a4e8468fe2"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:47:38.990027 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-8d49c32e-aef3-48c9-b419-2896edb47aec req-81fd910a-0259-4f9c-b738-522a653aa736 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:47:38.990473 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-8d49c32e-aef3-48c9-b419-2896edb47aec req-81fd910a-0259-4f9c-b738-522a653aa736 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:47:39.005139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-8d49c32e-aef3-48c9-b419-2896edb47aec req-81fd910a-0259-4f9c-b738-522a653aa736 service nova] Creating event network-changed:ebc7fc3d-47c6-4726-9b7f-a4a4e8468fe2 for instance e9f07c88-96f8-48c2-8523-be0e7981ee79 on hv-cinder-85104 Jul 26 16:47:39.010230 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-8d49c32e-aef3-48c9-b419-2896edb47aec req-81fd910a-0259-4f9c-b738-522a653aa736 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035457 Jul 26 16:47:39.011657 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 599/1211] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:47:47.906698 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:47:47.907367 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:47:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:47:49.624655 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:47:49.625505 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:47:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:48:05.878400 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-dcb75f9e-0045-46e4-8d97-4f9bfd7006a9 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Action: 'create', calling method: .version_select at 0x7f4b6c1e18b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-366545046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEmagtJZ7JyZ14kTWO7ODnfs5fdpntRifahJAqwGNUxRbwGYTeka4RFSO6yeYrkA2/X/Ycnb1YoPGQxMXPKKmedmqMXHlT5iw1gPbFnLwQXJa5VfONVYxuEEG/EKKeKiw=="}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:48:05.895079 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-dcb75f9e-0045-46e4-8d97-4f9bfd7006a9 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Getting quotas for project 417fd6ab3a0c4537a10272ee14f1cadb. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:48:05.898979 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.quota [None req-dcb75f9e-0045-46e4-8d97-4f9bfd7006a9 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Getting quotas for user e57b5c97a19a42c28156f1fc82384fc1 and project 417fd6ab3a0c4537a10272ee14f1cadb. Resources: {'key_pairs'} {{(pid=124821) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:48:05.990314 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-dcb75f9e-0045-46e4-8d97-4f9bfd7006a9 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.116081 Jul 26 16:48:05.990847 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 613/1212] 10.222.0.144 () {60 vars in 1164 bytes} [Tue Jul 26 16:48:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:48:06.039035 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=3 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:06.039793 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=7 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:06.043807 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1635575750", "imageRef": "5245177f-4785-459f-b167-264ca35db7e9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-366545046", "networks": [{"uuid": "0f8d41b7-e7c9-4cf1-a564-2b0d8ecf8dd2"}]}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:48:06.094452 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.network.neutron [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] validate_networks() for [('0f8d41b7-e7c9-4cf1-a564-2b0d8ecf8dd2', None, None, None, None, None)] {{(pid=124820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:48:06.565256 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Flavor limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:48:06.565673 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Image limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:48:06.566139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Flavor pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:48:06.566558 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Image pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:48:06.566946 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:48:06.575709 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:06.576150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:06.576973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:06.577400 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:06.593671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Getting quotas for project 417fd6ab3a0c4537a10272ee14f1cadb. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:48:06.597621 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Getting quotas for user e57b5c97a19a42c28156f1fc82384fc1 and project 417fd6ab3a0c4537a10272ee14f1cadb. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:48:06.608770 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Going to run 1 instances... {{(pid=124820) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:48:06.612372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5245177f-4785-459f-b167-264ca35db7e9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:48:06.774758 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7d449b4a-b544-4d6f-953f-858e8c1b2b86 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.737054 Jul 26 16:48:06.775400 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 600/1213] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:48:06 2022] POST /compute/v2.1/servers => generated 382 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:48:06.787405 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-fe51f430-2bdb-4586-8c4c-cfb7a2047219 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:06.788022 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-fe51f430-2bdb-4586-8c4c-cfb7a2047219 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:06.842461 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-fe51f430-2bdb-4586-8c4c-cfb7a2047219 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:06.849187 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-fe51f430-2bdb-4586-8c4c-cfb7a2047219 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1262 microversion: 2.1 time: 0.066243 Jul 26 16:48:06.849755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 614/1214] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:06 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1262 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:07.870262 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8d12eec2-5584-41e3-a759-eea1e44e723e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:07.870995 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8d12eec2-5584-41e3-a759-eea1e44e723e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:07.930822 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8d12eec2-5584-41e3-a759-eea1e44e723e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:07.938228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8d12eec2-5584-41e3-a759-eea1e44e723e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1262 microversion: 2.1 time: 0.072438 Jul 26 16:48:07.938789 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 601/1215] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:07 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:08.958726 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-317c9a00-7fa2-49ad-98e8-c1f861dd1247 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:08.959345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-317c9a00-7fa2-49ad-98e8-c1f861dd1247 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:08.967229 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-317c9a00-7fa2-49ad-98e8-c1f861dd1247 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:08.967679 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-317c9a00-7fa2-49ad-98e8-c1f861dd1247 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:08.968923 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-317c9a00-7fa2-49ad-98e8-c1f861dd1247 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:08.968923 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-317c9a00-7fa2-49ad-98e8-c1f861dd1247 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:09.036136 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-317c9a00-7fa2-49ad-98e8-c1f861dd1247 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:09.043615 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-317c9a00-7fa2-49ad-98e8-c1f861dd1247 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1258 microversion: 2.1 time: 0.088850 Jul 26 16:48:09.044915 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 615/1216] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:08 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:10.066083 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bf1407cc-978e-4a34-a86a-b796cd228f96 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:10.066973 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bf1407cc-978e-4a34-a86a-b796cd228f96 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:10.073692 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bf1407cc-978e-4a34-a86a-b796cd228f96 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:10.074485 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bf1407cc-978e-4a34-a86a-b796cd228f96 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:10.075575 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bf1407cc-978e-4a34-a86a-b796cd228f96 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:10.076239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bf1407cc-978e-4a34-a86a-b796cd228f96 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:10.145495 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bf1407cc-978e-4a34-a86a-b796cd228f96 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:10.153569 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bf1407cc-978e-4a34-a86a-b796cd228f96 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1332 microversion: 2.1 time: 0.091330 Jul 26 16:48:10.154140 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 602/1217] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:10 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1332 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:11.174938 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f26d59a0-b931-4472-bbdb-19054ba5dcde tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:11.175574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f26d59a0-b931-4472-bbdb-19054ba5dcde tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:11.187315 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f26d59a0-b931-4472-bbdb-19054ba5dcde tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:11.187315 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f26d59a0-b931-4472-bbdb-19054ba5dcde tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:11.187315 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f26d59a0-b931-4472-bbdb-19054ba5dcde tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:11.187315 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f26d59a0-b931-4472-bbdb-19054ba5dcde tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:11.315615 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f26d59a0-b931-4472-bbdb-19054ba5dcde tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:11.323729 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f26d59a0-b931-4472-bbdb-19054ba5dcde tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.152617 Jul 26 16:48:11.336547 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 616/1218] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:11 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:12.346652 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e8ef9b3a-2d48-48b1-b086-3eea450851ed tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:12.347268 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e8ef9b3a-2d48-48b1-b086-3eea450851ed tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:12.353843 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8ef9b3a-2d48-48b1-b086-3eea450851ed tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:12.354296 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8ef9b3a-2d48-48b1-b086-3eea450851ed tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:12.355060 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8ef9b3a-2d48-48b1-b086-3eea450851ed tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:12.355497 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e8ef9b3a-2d48-48b1-b086-3eea450851ed tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:12.480020 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e8ef9b3a-2d48-48b1-b086-3eea450851ed tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:12.487967 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e8ef9b3a-2d48-48b1-b086-3eea450851ed tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.145235 Jul 26 16:48:12.488559 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 603/1219] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:12 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:13.509093 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c7b0e1c0-0b8d-4903-adc4-abdcbb0f6865 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:13.509706 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c7b0e1c0-0b8d-4903-adc4-abdcbb0f6865 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:13.517045 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c7b0e1c0-0b8d-4903-adc4-abdcbb0f6865 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:13.517492 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c7b0e1c0-0b8d-4903-adc4-abdcbb0f6865 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:13.518264 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c7b0e1c0-0b8d-4903-adc4-abdcbb0f6865 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:13.518700 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c7b0e1c0-0b8d-4903-adc4-abdcbb0f6865 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:13.659150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c7b0e1c0-0b8d-4903-adc4-abdcbb0f6865 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:13.669366 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c7b0e1c0-0b8d-4903-adc4-abdcbb0f6865 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.164114 Jul 26 16:48:13.670007 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 617/1220] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:13 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:14.693475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e4e1c502-c612-48cc-9a14-63e14bd3b201 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:14.694130 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e4e1c502-c612-48cc-9a14-63e14bd3b201 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:14.700686 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e4e1c502-c612-48cc-9a14-63e14bd3b201 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:14.701162 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e4e1c502-c612-48cc-9a14-63e14bd3b201 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:14.701932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e4e1c502-c612-48cc-9a14-63e14bd3b201 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:14.702457 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e4e1c502-c612-48cc-9a14-63e14bd3b201 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:14.847560 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-e4e1c502-c612-48cc-9a14-63e14bd3b201 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:14.854836 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e4e1c502-c612-48cc-9a14-63e14bd3b201 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.165285 Jul 26 16:48:14.855394 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 604/1221] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:14 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:15.875142 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-2722784c-9134-4d3f-8289-cbac0838b17a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:15.875805 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-2722784c-9134-4d3f-8289-cbac0838b17a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:15.882282 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2722784c-9134-4d3f-8289-cbac0838b17a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:15.882733 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2722784c-9134-4d3f-8289-cbac0838b17a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:15.883490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2722784c-9134-4d3f-8289-cbac0838b17a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:15.883923 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-2722784c-9134-4d3f-8289-cbac0838b17a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:16.013288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-2722784c-9134-4d3f-8289-cbac0838b17a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:16.020713 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-2722784c-9134-4d3f-8289-cbac0838b17a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.149333 Jul 26 16:48:16.021211 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 618/1222] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:15 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:17.041527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9b4f1ccc-0e17-467c-8d42-9fe43b423bee tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:17.042148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9b4f1ccc-0e17-467c-8d42-9fe43b423bee tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:17.044371 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:17.049219 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9b4f1ccc-0e17-467c-8d42-9fe43b423bee tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:17.049668 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9b4f1ccc-0e17-467c-8d42-9fe43b423bee tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:17.050424 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9b4f1ccc-0e17-467c-8d42-9fe43b423bee tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:17.050855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9b4f1ccc-0e17-467c-8d42-9fe43b423bee tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:17.179593 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9b4f1ccc-0e17-467c-8d42-9fe43b423bee tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:17.205598 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9b4f1ccc-0e17-467c-8d42-9fe43b423bee tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.167660 Jul 26 16:48:17.206412 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 605/1223] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:17 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:18.226560 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f436fb36-2f0c-4598-8a18-3092fb158862 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:18.227237 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f436fb36-2f0c-4598-8a18-3092fb158862 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:18.229050 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=6 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:18.234895 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f436fb36-2f0c-4598-8a18-3092fb158862 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:18.235344 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f436fb36-2f0c-4598-8a18-3092fb158862 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:18.236176 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f436fb36-2f0c-4598-8a18-3092fb158862 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:18.236647 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f436fb36-2f0c-4598-8a18-3092fb158862 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:18.377142 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f436fb36-2f0c-4598-8a18-3092fb158862 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:18.384634 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f436fb36-2f0c-4598-8a18-3092fb158862 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.161929 Jul 26 16:48:18.385197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 619/1224] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:18 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:19.401970 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=8 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:19.407449 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-9fd9efe2-d1f1-4b40-9b55-c2b57ba25772 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:19.408061 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-9fd9efe2-d1f1-4b40-9b55-c2b57ba25772 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:19.414948 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9fd9efe2-d1f1-4b40-9b55-c2b57ba25772 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:19.415424 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9fd9efe2-d1f1-4b40-9b55-c2b57ba25772 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:19.416190 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9fd9efe2-d1f1-4b40-9b55-c2b57ba25772 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:19.416641 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-9fd9efe2-d1f1-4b40-9b55-c2b57ba25772 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:19.566583 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-9fd9efe2-d1f1-4b40-9b55-c2b57ba25772 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:19.574091 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-9fd9efe2-d1f1-4b40-9b55-c2b57ba25772 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.172911 Jul 26 16:48:19.575230 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 606/1225] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:19 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:20.598396 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b4f46852-2f01-41a0-a2fe-b5993b4e0c00 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:20.600596 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b4f46852-2f01-41a0-a2fe-b5993b4e0c00 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:20.608571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b4f46852-2f01-41a0-a2fe-b5993b4e0c00 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:20.611846 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b4f46852-2f01-41a0-a2fe-b5993b4e0c00 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:20.611846 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b4f46852-2f01-41a0-a2fe-b5993b4e0c00 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:20.611846 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b4f46852-2f01-41a0-a2fe-b5993b4e0c00 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:20.775589 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b4f46852-2f01-41a0-a2fe-b5993b4e0c00 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:20.783986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b4f46852-2f01-41a0-a2fe-b5993b4e0c00 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.189771 Jul 26 16:48:20.784598 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 620/1226] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:20 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:21.806531 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d691ccf9-eaa0-4898-b5a8-3ab77f787079 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:21.807162 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d691ccf9-eaa0-4898-b5a8-3ab77f787079 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:21.813663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d691ccf9-eaa0-4898-b5a8-3ab77f787079 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:21.814114 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d691ccf9-eaa0-4898-b5a8-3ab77f787079 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:21.814867 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d691ccf9-eaa0-4898-b5a8-3ab77f787079 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:21.815301 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d691ccf9-eaa0-4898-b5a8-3ab77f787079 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:21.943700 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d691ccf9-eaa0-4898-b5a8-3ab77f787079 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:21.951684 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d691ccf9-eaa0-4898-b5a8-3ab77f787079 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.149698 Jul 26 16:48:21.952330 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 607/1227] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:21 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:22.972507 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ff5a165c-c81a-4ca8-8333-b2bfb1951527 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:22.973134 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ff5a165c-c81a-4ca8-8333-b2bfb1951527 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:22.979726 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ff5a165c-c81a-4ca8-8333-b2bfb1951527 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:22.980177 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ff5a165c-c81a-4ca8-8333-b2bfb1951527 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:22.981033 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ff5a165c-c81a-4ca8-8333-b2bfb1951527 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:22.981472 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ff5a165c-c81a-4ca8-8333-b2bfb1951527 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:23.111118 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ff5a165c-c81a-4ca8-8333-b2bfb1951527 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:23.118914 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ff5a165c-c81a-4ca8-8333-b2bfb1951527 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.150333 Jul 26 16:48:23.119479 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 621/1228] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:22 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:24.139863 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-047981be-b862-4c39-b675-d01380474960 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:24.141228 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-047981be-b862-4c39-b675-d01380474960 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:24.147613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-047981be-b862-4c39-b675-d01380474960 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:24.148306 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-047981be-b862-4c39-b675-d01380474960 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:24.149308 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-047981be-b862-4c39-b675-d01380474960 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:24.149914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-047981be-b862-4c39-b675-d01380474960 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:24.287346 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-047981be-b862-4c39-b675-d01380474960 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:24.295102 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-047981be-b862-4c39-b675-d01380474960 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.159662 Jul 26 16:48:24.295665 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 608/1229] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:24 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:24.814574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-1a8d3169-5602-4945-9b64-a89c8c57273f req-0e84bfe9-7170-4d72-9461-06711a4a181e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5531a6cc-8353-49bf-b227-655e10297753", "tag": "47897c7d-52ee-4bd9-915e-f01b08aa844a"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:48:24.845891 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-1a8d3169-5602-4945-9b64-a89c8c57273f req-0e84bfe9-7170-4d72-9461-06711a4a181e service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:24.846341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-1a8d3169-5602-4945-9b64-a89c8c57273f req-0e84bfe9-7170-4d72-9461-06711a4a181e service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:24.862274 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-1a8d3169-5602-4945-9b64-a89c8c57273f req-0e84bfe9-7170-4d72-9461-06711a4a181e service nova] Creating event network-changed:47897c7d-52ee-4bd9-915e-f01b08aa844a for instance 5531a6cc-8353-49bf-b227-655e10297753 on hv-cinder-85104 Jul 26 16:48:24.867473 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-1a8d3169-5602-4945-9b64-a89c8c57273f req-0e84bfe9-7170-4d72-9461-06711a4a181e service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056982 Jul 26 16:48:24.868246 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 622/1230] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:48:25.316668 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d26ebf95-7696-4224-beeb-7a88992eb299 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:25.317295 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d26ebf95-7696-4224-beeb-7a88992eb299 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:25.323816 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d26ebf95-7696-4224-beeb-7a88992eb299 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:25.324262 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d26ebf95-7696-4224-beeb-7a88992eb299 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:25.325475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d26ebf95-7696-4224-beeb-7a88992eb299 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:25.325916 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d26ebf95-7696-4224-beeb-7a88992eb299 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:25.463957 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d26ebf95-7696-4224-beeb-7a88992eb299 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:25.474139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d26ebf95-7696-4224-beeb-7a88992eb299 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.160279 Jul 26 16:48:25.474666 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 609/1231] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:25 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:26.496121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-41f7a0e3-0b2d-4453-8f34-3ea2a2d353aa tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:26.497355 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-41f7a0e3-0b2d-4453-8f34-3ea2a2d353aa tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:26.503510 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41f7a0e3-0b2d-4453-8f34-3ea2a2d353aa tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:26.503958 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41f7a0e3-0b2d-4453-8f34-3ea2a2d353aa tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:26.504758 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41f7a0e3-0b2d-4453-8f34-3ea2a2d353aa tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:26.505203 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-41f7a0e3-0b2d-4453-8f34-3ea2a2d353aa tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:26.632059 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-41f7a0e3-0b2d-4453-8f34-3ea2a2d353aa tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:26.639440 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-41f7a0e3-0b2d-4453-8f34-3ea2a2d353aa tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.148048 Jul 26 16:48:26.639988 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 623/1232] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:26 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:27.659827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8784bd13-d2b9-4f62-bbd5-0d157ae0fb6c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:27.660714 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8784bd13-d2b9-4f62-bbd5-0d157ae0fb6c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:27.667244 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8784bd13-d2b9-4f62-bbd5-0d157ae0fb6c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:27.667696 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8784bd13-d2b9-4f62-bbd5-0d157ae0fb6c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:27.668505 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8784bd13-d2b9-4f62-bbd5-0d157ae0fb6c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:27.668942 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8784bd13-d2b9-4f62-bbd5-0d157ae0fb6c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:27.796823 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8784bd13-d2b9-4f62-bbd5-0d157ae0fb6c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:27.804143 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8784bd13-d2b9-4f62-bbd5-0d157ae0fb6c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.148127 Jul 26 16:48:27.804722 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 610/1233] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:27 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:28.825359 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b17fb99f-bcf6-4975-843e-a56ee4c79a11 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:28.825912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b17fb99f-bcf6-4975-843e-a56ee4c79a11 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:28.832297 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b17fb99f-bcf6-4975-843e-a56ee4c79a11 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:28.832773 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b17fb99f-bcf6-4975-843e-a56ee4c79a11 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:28.833528 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b17fb99f-bcf6-4975-843e-a56ee4c79a11 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:28.833977 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b17fb99f-bcf6-4975-843e-a56ee4c79a11 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:28.965232 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b17fb99f-bcf6-4975-843e-a56ee4c79a11 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:28.972461 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b17fb99f-bcf6-4975-843e-a56ee4c79a11 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.151036 Jul 26 16:48:28.973009 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 624/1234] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:28 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:29.993334 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6c76a79e-d70e-4b2d-a300-93df7a612f47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:29.993951 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6c76a79e-d70e-4b2d-a300-93df7a612f47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:30.001031 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6c76a79e-d70e-4b2d-a300-93df7a612f47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:30.001481 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6c76a79e-d70e-4b2d-a300-93df7a612f47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:30.002246 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6c76a79e-d70e-4b2d-a300-93df7a612f47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:30.002686 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6c76a79e-d70e-4b2d-a300-93df7a612f47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:30.134150 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6c76a79e-d70e-4b2d-a300-93df7a612f47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:30.142343 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6c76a79e-d70e-4b2d-a300-93df7a612f47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.152931 Jul 26 16:48:30.143796 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 611/1235] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:29 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:31.166969 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-64ea4ee9-5e9d-4945-9d59-a6f843762678 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:31.167586 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-64ea4ee9-5e9d-4945-9d59-a6f843762678 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:31.174260 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64ea4ee9-5e9d-4945-9d59-a6f843762678 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:31.174711 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64ea4ee9-5e9d-4945-9d59-a6f843762678 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:31.175504 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64ea4ee9-5e9d-4945-9d59-a6f843762678 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:31.175940 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-64ea4ee9-5e9d-4945-9d59-a6f843762678 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:31.308183 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-64ea4ee9-5e9d-4945-9d59-a6f843762678 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:31.316092 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-64ea4ee9-5e9d-4945-9d59-a6f843762678 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.153164 Jul 26 16:48:31.316683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 625/1236] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:31 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:31.808778 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-20d2f858-a9ae-468e-ad5d-1218d69520ac req-e5be7281-fdcb-4c05-8eb3-c458c6fb1fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5531a6cc-8353-49bf-b227-655e10297753", "name": "network-vif-plugged", "status": "completed", "tag": "47897c7d-52ee-4bd9-915e-f01b08aa844a"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:48:31.818744 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-20d2f858-a9ae-468e-ad5d-1218d69520ac req-e5be7281-fdcb-4c05-8eb3-c458c6fb1fa2 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:31.819196 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-20d2f858-a9ae-468e-ad5d-1218d69520ac req-e5be7281-fdcb-4c05-8eb3-c458c6fb1fa2 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:31.830947 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-20d2f858-a9ae-468e-ad5d-1218d69520ac req-e5be7281-fdcb-4c05-8eb3-c458c6fb1fa2 service nova] Creating event network-vif-plugged:47897c7d-52ee-4bd9-915e-f01b08aa844a for instance 5531a6cc-8353-49bf-b227-655e10297753 on hv-cinder-85104 Jul 26 16:48:31.835941 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-20d2f858-a9ae-468e-ad5d-1218d69520ac req-e5be7281-fdcb-4c05-8eb3-c458c6fb1fa2 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030864 Jul 26 16:48:31.836553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 612/1237] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:48:32.336863 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ec7ffd1e-96af-47f8-9bf5-36cc21ea35fe tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:32.337476 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ec7ffd1e-96af-47f8-9bf5-36cc21ea35fe tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:32.343848 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec7ffd1e-96af-47f8-9bf5-36cc21ea35fe tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:32.344318 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec7ffd1e-96af-47f8-9bf5-36cc21ea35fe tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:32.345121 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec7ffd1e-96af-47f8-9bf5-36cc21ea35fe tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:32.345573 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ec7ffd1e-96af-47f8-9bf5-36cc21ea35fe tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:32.474082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ec7ffd1e-96af-47f8-9bf5-36cc21ea35fe tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:32.481446 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ec7ffd1e-96af-47f8-9bf5-36cc21ea35fe tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.148623 Jul 26 16:48:32.482002 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 626/1238] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:32 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:33.502966 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-cd384cff-4840-4918-8f63-a49cd6c244ab tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:33.503673 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-cd384cff-4840-4918-8f63-a49cd6c244ab tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:33.509916 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd384cff-4840-4918-8f63-a49cd6c244ab tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:33.510371 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd384cff-4840-4918-8f63-a49cd6c244ab tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:33.511139 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd384cff-4840-4918-8f63-a49cd6c244ab tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:33.511579 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-cd384cff-4840-4918-8f63-a49cd6c244ab tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:33.640564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-cd384cff-4840-4918-8f63-a49cd6c244ab tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:33.648606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-cd384cff-4840-4918-8f63-a49cd6c244ab tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1362 microversion: 2.1 time: 0.149705 Jul 26 16:48:33.649161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 613/1239] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:33 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:34.669851 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7ac04274-b577-4102-9fd1-df924e70c674 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:34.670464 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7ac04274-b577-4102-9fd1-df924e70c674 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:34.677046 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ac04274-b577-4102-9fd1-df924e70c674 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:34.677500 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ac04274-b577-4102-9fd1-df924e70c674 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:34.678264 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ac04274-b577-4102-9fd1-df924e70c674 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:34.678699 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7ac04274-b577-4102-9fd1-df924e70c674 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:34.807311 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-7ac04274-b577-4102-9fd1-df924e70c674 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:34.815392 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7ac04274-b577-4102-9fd1-df924e70c674 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1553 microversion: 2.1 time: 0.149415 Jul 26 16:48:34.815954 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 627/1240] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:34 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:34.835118 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-811ae19d-c18f-45f7-8b77-b8ddc822ee94 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:34.835751 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-811ae19d-c18f-45f7-8b77-b8ddc822ee94 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:34.842230 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-811ae19d-c18f-45f7-8b77-b8ddc822ee94 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:34.842678 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-811ae19d-c18f-45f7-8b77-b8ddc822ee94 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:34.843439 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-811ae19d-c18f-45f7-8b77-b8ddc822ee94 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:34.843871 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-811ae19d-c18f-45f7-8b77-b8ddc822ee94 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:34.975486 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-811ae19d-c18f-45f7-8b77-b8ddc822ee94 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:34.983337 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-811ae19d-c18f-45f7-8b77-b8ddc822ee94 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1553 microversion: 2.1 time: 0.152096 Jul 26 16:48:34.983904 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 614/1241] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:34 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:35.003073 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-8337bfe4-ca63-4914-ba7f-67c1f612d912 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:35.007761 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-8337bfe4-ca63-4914-ba7f-67c1f612d912 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:35.008554 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-8337bfe4-ca63-4914-ba7f-67c1f612d912 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Searching by: {'deleted': False, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb'} {{(pid=124821) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 26 16:48:35.015190 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8337bfe4-ca63-4914-ba7f-67c1f612d912 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:35.015639 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8337bfe4-ca63-4914-ba7f-67c1f612d912 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:35.016458 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8337bfe4-ca63-4914-ba7f-67c1f612d912 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:35.016896 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-8337bfe4-ca63-4914-ba7f-67c1f612d912 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:35.104727 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.multi_cell_list [None req-8337bfe4-ca63-4914-ba7f-67c1f612d912 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124821) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 26 16:48:35.196133 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-8337bfe4-ca63-4914-ba7f-67c1f612d912 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.196659 Jul 26 16:48:35.196657 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 628/1242] 10.222.0.144 () {58 vars in 1130 bytes} [Tue Jul 26 16:48:34 2022] GET /compute/v2.1/servers => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:48:35.207781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-96b6d2d7-45cb-4a9c-a225-6a15466c8f85 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:35.208409 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-96b6d2d7-45cb-4a9c-a225-6a15466c8f85 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:35.214390 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-96b6d2d7-45cb-4a9c-a225-6a15466c8f85 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:35.214837 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-96b6d2d7-45cb-4a9c-a225-6a15466c8f85 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:35.216109 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-96b6d2d7-45cb-4a9c-a225-6a15466c8f85 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:35.216578 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-96b6d2d7-45cb-4a9c-a225-6a15466c8f85 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:35.346200 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-96b6d2d7-45cb-4a9c-a225-6a15466c8f85 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:35.353707 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-96b6d2d7-45cb-4a9c-a225-6a15466c8f85 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1553 microversion: 2.1 time: 0.149795 Jul 26 16:48:35.354278 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 615/1243] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:35 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:38.259997 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d0f3c5f2-14b9-4c16-b703-f6f1512064c2 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "901abcda-c13e-4d69-9b0f-c8e19c2c5870"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:48:38.262326 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d0f3c5f2-14b9-4c16-b703-f6f1512064c2 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:38.265345 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:38.270047 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0f3c5f2-14b9-4c16-b703-f6f1512064c2 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:38.270498 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0f3c5f2-14b9-4c16-b703-f6f1512064c2 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:38.271259 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0f3c5f2-14b9-4c16-b703-f6f1512064c2 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:38.271695 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0f3c5f2-14b9-4c16-b703-f6f1512064c2 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:38.275259 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=92 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:39.227191 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d0f3c5f2-14b9-4c16-b703-f6f1512064c2 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "POST /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.970512 Jul 26 16:48:39.227444 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 629/1244] 10.222.0.144 () {60 vars in 1328 bytes} [Tue Jul 26 16:48:38 2022] POST /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments => generated 194 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:48:48.025372 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-11a8787c-fefc-4813-8af3-587521177e45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:48.026955 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-11a8787c-fefc-4813-8af3-587521177e45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:48.029600 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:48.030251 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=82 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:48.035589 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11a8787c-fefc-4813-8af3-587521177e45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:48.041724 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11a8787c-fefc-4813-8af3-587521177e45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:48.041724 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11a8787c-fefc-4813-8af3-587521177e45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:48.041724 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-11a8787c-fefc-4813-8af3-587521177e45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:48.169935 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-11a8787c-fefc-4813-8af3-587521177e45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:48.178113 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-11a8787c-fefc-4813-8af3-587521177e45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1599 microversion: 2.1 time: 0.156958 Jul 26 16:48:48.178682 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 616/1245] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:48 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:48:50.385721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-00925e7c-72f8-4135-8e6d-974f95b35eec req-f7a82d05-755b-4138-aeff-5a1df4dd1e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5531a6cc-8353-49bf-b227-655e10297753", "tag": "47897c7d-52ee-4bd9-915e-f01b08aa844a"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:48:50.397180 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:50.398107 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:50.398797 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:48:50.401203 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-00925e7c-72f8-4135-8e6d-974f95b35eec req-f7a82d05-755b-4138-aeff-5a1df4dd1e29 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:50.401643 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-00925e7c-72f8-4135-8e6d-974f95b35eec req-f7a82d05-755b-4138-aeff-5a1df4dd1e29 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:50.417195 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-00925e7c-72f8-4135-8e6d-974f95b35eec req-f7a82d05-755b-4138-aeff-5a1df4dd1e29 service nova] Creating event network-changed:47897c7d-52ee-4bd9-915e-f01b08aa844a for instance 5531a6cc-8353-49bf-b227-655e10297753 on hv-cinder-85104 Jul 26 16:48:50.422847 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-00925e7c-72f8-4135-8e6d-974f95b35eec req-f7a82d05-755b-4138-aeff-5a1df4dd1e29 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040962 Jul 26 16:48:50.425311 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 630/1246] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:48:53.893620 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-94deaf2c-1418-4ab1-8656-2816efecaccf tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-793294290"}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:48:53.894295 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-94deaf2c-1418-4ab1-8656-2816efecaccf tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:53.901505 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94deaf2c-1418-4ab1-8656-2816efecaccf tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:53.901954 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94deaf2c-1418-4ab1-8656-2816efecaccf tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:53.902729 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94deaf2c-1418-4ab1-8656-2816efecaccf tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:53.903142 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-94deaf2c-1418-4ab1-8656-2816efecaccf tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:54.027503 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.network.security_group_api [None req-94deaf2c-1418-4ab1-8656-2816efecaccf tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Adding security group 5d52cb50-4801-421b-9581-b12f0aba3cf2 to port 47897c7d-52ee-4bd9-915e-f01b08aa844a Jul 26 16:48:54.456636 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-94deaf2c-1418-4ab1-8656-2816efecaccf tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "POST /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/action" status: 202 len: 0 microversion: 2.1 time: 0.567123 Jul 26 16:48:54.458060 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 617/1247] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:48:53 2022] POST /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:48:54.466094 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-ffe2f2b2-f56a-456e-b61e-02d4ee533182 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:48:54.473054 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-ffe2f2b2-f56a-456e-b61e-02d4ee533182 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:48:54.482891 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ffe2f2b2-f56a-456e-b61e-02d4ee533182 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:54.484214 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ffe2f2b2-f56a-456e-b61e-02d4ee533182 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:54.485221 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ffe2f2b2-f56a-456e-b61e-02d4ee533182 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:54.485824 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-ffe2f2b2-f56a-456e-b61e-02d4ee533182 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:54.632740 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-a75be744-c213-410a-9203-bf19c7bba0f1 req-8398f776-b9f8-4370-946d-28cb9a21ecc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5531a6cc-8353-49bf-b227-655e10297753", "tag": "47897c7d-52ee-4bd9-915e-f01b08aa844a"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:48:54.642475 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-a75be744-c213-410a-9203-bf19c7bba0f1 req-8398f776-b9f8-4370-946d-28cb9a21ecc6 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:48:54.643436 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-a75be744-c213-410a-9203-bf19c7bba0f1 req-8398f776-b9f8-4370-946d-28cb9a21ecc6 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:48:54.661985 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-a75be744-c213-410a-9203-bf19c7bba0f1 req-8398f776-b9f8-4370-946d-28cb9a21ecc6 service nova] Creating event network-changed:47897c7d-52ee-4bd9-915e-f01b08aa844a for instance 5531a6cc-8353-49bf-b227-655e10297753 on hv-cinder-85104 Jul 26 16:48:54.669199 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-a75be744-c213-410a-9203-bf19c7bba0f1 req-8398f776-b9f8-4370-946d-28cb9a21ecc6 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208465 Jul 26 16:48:54.674754 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 631/1248] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:48:54.676561 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-ffe2f2b2-f56a-456e-b61e-02d4ee533182 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:48:54.687475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-ffe2f2b2-f56a-456e-b61e-02d4ee533182 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1764 microversion: 2.1 time: 0.224971 Jul 26 16:48:54.688055 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 618/1249] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:48:54 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1764 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:49:52.285721 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=4 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:49:52.290642 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-40989a40-7002-453a-af36-d9fa0cce0764 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:49:52.292890 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-40989a40-7002-453a-af36-d9fa0cce0764 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:52.311011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-40989a40-7002-453a-af36-d9fa0cce0764 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:52.311011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-40989a40-7002-453a-af36-d9fa0cce0764 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:52.311011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-40989a40-7002-453a-af36-d9fa0cce0764 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:52.311011 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-40989a40-7002-453a-af36-d9fa0cce0764 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:52.608789 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-40989a40-7002-453a-af36-d9fa0cce0764 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "POST /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/action" status: 202 len: 0 microversion: 2.1 time: 0.324378 Jul 26 16:49:52.609508 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 632/1250] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:49:52 2022] POST /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:49:52.617718 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8a6e8a40-14ff-499e-91a3-f5a28b051b8b tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:52.618336 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8a6e8a40-14ff-499e-91a3-f5a28b051b8b tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:52.620655 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=6 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:49:52.621343 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=16 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:49:52.626977 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a6e8a40-14ff-499e-91a3-f5a28b051b8b tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:52.627438 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a6e8a40-14ff-499e-91a3-f5a28b051b8b tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:52.628266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a6e8a40-14ff-499e-91a3-f5a28b051b8b tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:52.628772 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8a6e8a40-14ff-499e-91a3-f5a28b051b8b tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:52.768032 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8a6e8a40-14ff-499e-91a3-f5a28b051b8b tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:49:52.776124 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8a6e8a40-14ff-499e-91a3-f5a28b051b8b tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1756 microversion: 2.1 time: 0.162356 Jul 26 16:49:52.776735 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 619/1251] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:52 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:49:53.798936 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ffbd8764-e710-43d4-a1c3-6ccffa09a067 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:53.799547 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ffbd8764-e710-43d4-a1c3-6ccffa09a067 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:53.805799 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ffbd8764-e710-43d4-a1c3-6ccffa09a067 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:53.806253 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ffbd8764-e710-43d4-a1c3-6ccffa09a067 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:53.807025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ffbd8764-e710-43d4-a1c3-6ccffa09a067 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:53.807464 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ffbd8764-e710-43d4-a1c3-6ccffa09a067 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:53.959954 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ffbd8764-e710-43d4-a1c3-6ccffa09a067 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:49:53.968429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ffbd8764-e710-43d4-a1c3-6ccffa09a067 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1761 microversion: 2.1 time: 0.174749 Jul 26 16:49:53.969041 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 633/1252] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:53 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1761 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:49:54.385308 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1830341021", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-828638125", "security_groups": [{"name": "tempest-secgroup-smoke-1873328593"}], "block_device_mapping_v2": [{"uuid": "6918746c-6e15-478a-ac76-5db44e8c1414", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f248d137-b4b6-4a4b-82ad-d9d4bbbe5d97"}]}} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:49:54.495299 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.network.neutron [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] validate_networks() for [('f248d137-b4b6-4a4b-82ad-d9d4bbbe5d97', None, None, None, None, None)] {{(pid=124820) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 26 16:49:54.855798 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Flavor limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 26 16:49:54.856227 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Image limits 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 26 16:49:54.856740 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Flavor pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 26 16:49:54.857152 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Image pref 0:0:0 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 26 16:49:54.857562 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.virt.hardware [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124820) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 26 16:49:54.866408 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:54.866851 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:54.867645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:54.868081 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:54.885071 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Getting quotas for project 94684df47fe14e55af2e72ab5d2ddc48. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 26 16:49:54.889585 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.quota [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Getting quotas for user ea4ccbb465094f079dcc4ca3bcac59cb and project 94684df47fe14e55af2e72ab5d2ddc48. Resources: {'instances', 'cores', 'ram'} {{(pid=124820) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 26 16:49:54.944842 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Going to run 1 instances... {{(pid=124820) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 26 16:49:54.946906 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6918746c-6e15-478a-ac76-5db44e8c1414',volume_size=None,volume_type=None)] {{(pid=124820) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 26 16:49:54.990082 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-b0f284a7-3673-4ddd-9531-399fe8fea58c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:54.990689 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-b0f284a7-3673-4ddd-9531-399fe8fea58c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:54.997072 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b0f284a7-3673-4ddd-9531-399fe8fea58c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:54.998097 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b0f284a7-3673-4ddd-9531-399fe8fea58c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:54.998853 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b0f284a7-3673-4ddd-9531-399fe8fea58c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:54.999290 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-b0f284a7-3673-4ddd-9531-399fe8fea58c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:55.137696 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-b0f284a7-3673-4ddd-9531-399fe8fea58c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:49:55.146007 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-b0f284a7-3673-4ddd-9531-399fe8fea58c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1761 microversion: 2.1 time: 0.159711 Jul 26 16:49:55.146571 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 634/1253] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:54 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1761 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:49:55.348885 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-944401a2-ff18-4463-8bef-405e53bde231 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.967207 Jul 26 16:49:55.349524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 620/1254] 10.222.0.144 () {60 vars in 1152 bytes} [Tue Jul 26 16:49:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 26 16:49:55.360613 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-48d0617a-b9c9-4b13-8e25-4953e006e7e3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:55.361221 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-48d0617a-b9c9-4b13-8e25-4953e006e7e3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:55.413364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-48d0617a-b9c9-4b13-8e25-4953e006e7e3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:49:55.420070 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-48d0617a-b9c9-4b13-8e25-4953e006e7e3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1097 microversion: 2.1 time: 0.063453 Jul 26 16:49:55.420672 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 635/1255] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:55 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1097 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:49:56.168887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-1249a828-89fe-4a65-95cf-04d42381bd40 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:56.169611 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-1249a828-89fe-4a65-95cf-04d42381bd40 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:56.176289 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1249a828-89fe-4a65-95cf-04d42381bd40 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:56.176756 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1249a828-89fe-4a65-95cf-04d42381bd40 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:56.177509 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1249a828-89fe-4a65-95cf-04d42381bd40 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:56.177934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-1249a828-89fe-4a65-95cf-04d42381bd40 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:56.324553 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-1249a828-89fe-4a65-95cf-04d42381bd40 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:49:56.333338 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-1249a828-89fe-4a65-95cf-04d42381bd40 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1761 microversion: 2.1 time: 0.169197 Jul 26 16:49:56.333900 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 621/1256] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:56 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1761 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:49:56.440705 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-95ec6014-aa89-4526-ac12-eec9fbd0a109 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:56.441307 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-95ec6014-aa89-4526-ac12-eec9fbd0a109 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:56.448131 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95ec6014-aa89-4526-ac12-eec9fbd0a109 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:56.448662 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95ec6014-aa89-4526-ac12-eec9fbd0a109 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:56.449477 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95ec6014-aa89-4526-ac12-eec9fbd0a109 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:56.449861 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-95ec6014-aa89-4526-ac12-eec9fbd0a109 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:56.513838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-95ec6014-aa89-4526-ac12-eec9fbd0a109 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:49:56.521277 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-95ec6014-aa89-4526-ac12-eec9fbd0a109 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1147 microversion: 2.1 time: 0.084413 Jul 26 16:49:56.521830 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 636/1257] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:56 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1147 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:49:57.354591 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d831666d-56b6-4a13-99c5-f5cf267221e0 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:57.355202 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d831666d-56b6-4a13-99c5-f5cf267221e0 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:57.362394 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d831666d-56b6-4a13-99c5-f5cf267221e0 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:57.362848 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d831666d-56b6-4a13-99c5-f5cf267221e0 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:57.363619 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d831666d-56b6-4a13-99c5-f5cf267221e0 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:57.364063 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d831666d-56b6-4a13-99c5-f5cf267221e0 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:57.515527 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d831666d-56b6-4a13-99c5-f5cf267221e0 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:49:57.523719 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d831666d-56b6-4a13-99c5-f5cf267221e0 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1761 microversion: 2.1 time: 0.172874 Jul 26 16:49:57.524239 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 622/1258] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:57 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1761 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:49:57.541889 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-87e70caa-527e-4f86-8317-cc6c0e6ddddb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:57.542501 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-87e70caa-527e-4f86-8317-cc6c0e6ddddb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:57.549263 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-87e70caa-527e-4f86-8317-cc6c0e6ddddb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:57.549949 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-87e70caa-527e-4f86-8317-cc6c0e6ddddb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:57.550803 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-87e70caa-527e-4f86-8317-cc6c0e6ddddb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:57.551232 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-87e70caa-527e-4f86-8317-cc6c0e6ddddb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:57.619219 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-87e70caa-527e-4f86-8317-cc6c0e6ddddb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:49:57.627387 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-87e70caa-527e-4f86-8317-cc6c0e6ddddb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1203 microversion: 2.1 time: 0.089247 Jul 26 16:49:57.628135 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 637/1259] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:57 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1203 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:49:58.544656 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6ec335e4-cbd3-4ae7-abc7-2d6c26374b77 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:58.545360 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6ec335e4-cbd3-4ae7-abc7-2d6c26374b77 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:58.551932 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6ec335e4-cbd3-4ae7-abc7-2d6c26374b77 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:58.552524 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6ec335e4-cbd3-4ae7-abc7-2d6c26374b77 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:58.553373 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6ec335e4-cbd3-4ae7-abc7-2d6c26374b77 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:58.553874 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6ec335e4-cbd3-4ae7-abc7-2d6c26374b77 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:58.648330 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-d0a24e04-2937-44b7-acb4-037dbb825c3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:58.649474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-d0a24e04-2937-44b7-acb4-037dbb825c3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:58.657515 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0a24e04-2937-44b7-acb4-037dbb825c3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:58.657969 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0a24e04-2937-44b7-acb4-037dbb825c3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:58.658952 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0a24e04-2937-44b7-acb4-037dbb825c3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:58.659533 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-d0a24e04-2937-44b7-acb4-037dbb825c3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:58.711598 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-6ec335e4-cbd3-4ae7-abc7-2d6c26374b77 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:49:58.719952 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6ec335e4-cbd3-4ae7-abc7-2d6c26374b77 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1761 microversion: 2.1 time: 0.179214 Jul 26 16:49:58.720565 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 623/1260] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:58 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1761 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:49:58.851313 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-d0a24e04-2937-44b7-acb4-037dbb825c3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:49:58.859748 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-d0a24e04-2937-44b7-acb4-037dbb825c3a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1281 microversion: 2.1 time: 0.215175 Jul 26 16:49:58.861479 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 638/1261] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:58 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1281 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:49:59.299478 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-b7f05d6e-4528-4782-882b-6cd53e381b86 req-9a228118-7b99-48f0-aa07-1cfff58138ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd36bc29-8c53-4965-96c9-26d3321bffbc", "tag": "7a0a4b81-bc50-4107-b252-2398b627a34c"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:49:59.310923 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-b7f05d6e-4528-4782-882b-6cd53e381b86 req-9a228118-7b99-48f0-aa07-1cfff58138ee service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:59.311455 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-b7f05d6e-4528-4782-882b-6cd53e381b86 req-9a228118-7b99-48f0-aa07-1cfff58138ee service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:59.323505 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-b7f05d6e-4528-4782-882b-6cd53e381b86 req-9a228118-7b99-48f0-aa07-1cfff58138ee service nova] Creating event network-changed:7a0a4b81-bc50-4107-b252-2398b627a34c for instance cd36bc29-8c53-4965-96c9-26d3321bffbc on hv-cinder-85104 Jul 26 16:49:59.329354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-b7f05d6e-4528-4782-882b-6cd53e381b86 req-9a228118-7b99-48f0-aa07-1cfff58138ee service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034316 Jul 26 16:49:59.332148 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 624/1262] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:49:59.741342 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-46aa1c0a-d7c0-442c-a71f-04bca509b35e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:59.741948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-46aa1c0a-d7c0-442c-a71f-04bca509b35e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:59.756271 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-46aa1c0a-d7c0-442c-a71f-04bca509b35e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:59.756271 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-46aa1c0a-d7c0-442c-a71f-04bca509b35e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:59.756271 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-46aa1c0a-d7c0-442c-a71f-04bca509b35e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:59.756271 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-46aa1c0a-d7c0-442c-a71f-04bca509b35e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:59.883302 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3141015e-e879-43c6-aefc-b91b199107ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:49:59.884224 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3141015e-e879-43c6-aefc-b91b199107ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:49:59.890709 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3141015e-e879-43c6-aefc-b91b199107ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:59.891256 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3141015e-e879-43c6-aefc-b91b199107ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:49:59.892097 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3141015e-e879-43c6-aefc-b91b199107ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:49:59.892630 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3141015e-e879-43c6-aefc-b91b199107ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:00.007914 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-46aa1c0a-d7c0-442c-a71f-04bca509b35e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:00.015945 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-46aa1c0a-d7c0-442c-a71f-04bca509b35e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1761 microversion: 2.1 time: 0.278399 Jul 26 16:50:00.029710 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 639/1263] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:59 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1761 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:00.029914 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-3141015e-e879-43c6-aefc-b91b199107ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:00.037592 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3141015e-e879-43c6-aefc-b91b199107ff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.159185 Jul 26 16:50:00.038149 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 625/1264] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:49:59 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:50:01.038538 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-f3cb3ea0-2aad-44ed-aebf-1ebfcc50a246 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:01.039132 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-f3cb3ea0-2aad-44ed-aebf-1ebfcc50a246 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:01.045572 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f3cb3ea0-2aad-44ed-aebf-1ebfcc50a246 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:01.046016 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f3cb3ea0-2aad-44ed-aebf-1ebfcc50a246 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:01.046768 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f3cb3ea0-2aad-44ed-aebf-1ebfcc50a246 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:01.047197 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-f3cb3ea0-2aad-44ed-aebf-1ebfcc50a246 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:01.058854 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-7e5ad96a-d18b-49f7-996d-e8997c9aa16b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:01.059465 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-7e5ad96a-d18b-49f7-996d-e8997c9aa16b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:01.066542 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e5ad96a-d18b-49f7-996d-e8997c9aa16b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:01.066996 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e5ad96a-d18b-49f7-996d-e8997c9aa16b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:01.067838 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e5ad96a-d18b-49f7-996d-e8997c9aa16b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:01.068195 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-7e5ad96a-d18b-49f7-996d-e8997c9aa16b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:01.190360 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-f3cb3ea0-2aad-44ed-aebf-1ebfcc50a246 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:01.197613 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-7e5ad96a-d18b-49f7-996d-e8997c9aa16b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:01.198301 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-f3cb3ea0-2aad-44ed-aebf-1ebfcc50a246 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1761 microversion: 2.1 time: 0.163840 Jul 26 16:50:01.198875 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 640/1265] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:01 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1761 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:01.205563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-7e5ad96a-d18b-49f7-996d-e8997c9aa16b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.150522 Jul 26 16:50:01.206110 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 626/1266] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:01 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:50:02.220415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-055aa407-8758-414e-b2e0-3ce1ea9d4a92 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:02.221023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-055aa407-8758-414e-b2e0-3ce1ea9d4a92 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:02.225886 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-bd5b3cfa-9b9e-4cb2-9206-0ac6787c0120 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:02.226499 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-bd5b3cfa-9b9e-4cb2-9206-0ac6787c0120 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:02.227470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-055aa407-8758-414e-b2e0-3ce1ea9d4a92 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:02.227916 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-055aa407-8758-414e-b2e0-3ce1ea9d4a92 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:02.228707 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-055aa407-8758-414e-b2e0-3ce1ea9d4a92 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:02.229139 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-055aa407-8758-414e-b2e0-3ce1ea9d4a92 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:02.233411 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd5b3cfa-9b9e-4cb2-9206-0ac6787c0120 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:02.233861 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd5b3cfa-9b9e-4cb2-9206-0ac6787c0120 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:02.234616 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd5b3cfa-9b9e-4cb2-9206-0ac6787c0120 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:02.235052 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-bd5b3cfa-9b9e-4cb2-9206-0ac6787c0120 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:02.369551 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-bd5b3cfa-9b9e-4cb2-9206-0ac6787c0120 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:02.376026 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-055aa407-8758-414e-b2e0-3ce1ea9d4a92 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:02.377900 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-bd5b3cfa-9b9e-4cb2-9206-0ac6787c0120 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.155788 Jul 26 16:50:02.378475 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 627/1267] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:02 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:02.383908 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-055aa407-8758-414e-b2e0-3ce1ea9d4a92 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1761 microversion: 2.1 time: 0.167965 Jul 26 16:50:02.384477 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 641/1268] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:02 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1761 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:03.399161 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-2dcc0e7d-0b5f-4d26-9774-b5c32898a910 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:03.399782 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-2dcc0e7d-0b5f-4d26-9774-b5c32898a910 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:03.405546 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-57436589-715f-42c4-aae4-8a2e74395d33 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:03.406152 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-57436589-715f-42c4-aae4-8a2e74395d33 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:03.406883 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2dcc0e7d-0b5f-4d26-9774-b5c32898a910 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:03.407331 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2dcc0e7d-0b5f-4d26-9774-b5c32898a910 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:03.408093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2dcc0e7d-0b5f-4d26-9774-b5c32898a910 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:03.408550 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-2dcc0e7d-0b5f-4d26-9774-b5c32898a910 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:03.412839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-57436589-715f-42c4-aae4-8a2e74395d33 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:03.413288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-57436589-715f-42c4-aae4-8a2e74395d33 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:03.414050 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-57436589-715f-42c4-aae4-8a2e74395d33 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:03.414671 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-57436589-715f-42c4-aae4-8a2e74395d33 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:03.541679 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-2dcc0e7d-0b5f-4d26-9774-b5c32898a910 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:03.549758 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-2dcc0e7d-0b5f-4d26-9774-b5c32898a910 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.154335 Jul 26 16:50:03.550392 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 628/1269] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:03 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:03.556985 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-57436589-715f-42c4-aae4-8a2e74395d33 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:03.565110 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-57436589-715f-42c4-aae4-8a2e74395d33 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1761 microversion: 2.1 time: 0.163792 Jul 26 16:50:03.565785 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 642/1270] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:03 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1761 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:50:04.570297 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-fda014ac-68b3-46c8-94f8-9f113ebdaf41 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:04.570907 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-fda014ac-68b3-46c8-94f8-9f113ebdaf41 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:04.577374 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fda014ac-68b3-46c8-94f8-9f113ebdaf41 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:04.577817 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fda014ac-68b3-46c8-94f8-9f113ebdaf41 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:04.578582 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fda014ac-68b3-46c8-94f8-9f113ebdaf41 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:04.579028 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-fda014ac-68b3-46c8-94f8-9f113ebdaf41 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:04.587650 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-34e1a7c2-281f-4f3c-ae8c-9276957fa3e6 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:04.588574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-34e1a7c2-281f-4f3c-ae8c-9276957fa3e6 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:04.595827 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34e1a7c2-281f-4f3c-ae8c-9276957fa3e6 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:04.597150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34e1a7c2-281f-4f3c-ae8c-9276957fa3e6 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:04.598009 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34e1a7c2-281f-4f3c-ae8c-9276957fa3e6 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:04.598550 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-34e1a7c2-281f-4f3c-ae8c-9276957fa3e6 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:04.719512 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-fda014ac-68b3-46c8-94f8-9f113ebdaf41 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:04.729059 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-fda014ac-68b3-46c8-94f8-9f113ebdaf41 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.162504 Jul 26 16:50:04.729642 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 629/1271] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:04 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:04.750755 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-34e1a7c2-281f-4f3c-ae8c-9276957fa3e6 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:04.758794 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-34e1a7c2-281f-4f3c-ae8c-9276957fa3e6 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1761 microversion: 2.1 time: 0.176973 Jul 26 16:50:04.764492 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 643/1272] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:04 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1761 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:50:05.751258 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-783bca30-da97-4af7-b2a4-51cfedee3e93 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:05.751872 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-783bca30-da97-4af7-b2a4-51cfedee3e93 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:05.753824 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=2 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:50:05.754489 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell0:SELECT=6 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:50:05.759800 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-783bca30-da97-4af7-b2a4-51cfedee3e93 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:05.761255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-783bca30-da97-4af7-b2a4-51cfedee3e93 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:05.761255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-783bca30-da97-4af7-b2a4-51cfedee3e93 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:05.761505 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-783bca30-da97-4af7-b2a4-51cfedee3e93 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:05.784104 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-654e0cd9-e7b6-4df9-8900-7588a5bccda7 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:05.784104 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-654e0cd9-e7b6-4df9-8900-7588a5bccda7 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:05.786476 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell0:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:50:05.790701 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-654e0cd9-e7b6-4df9-8900-7588a5bccda7 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:05.791145 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-654e0cd9-e7b6-4df9-8900-7588a5bccda7 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:05.791912 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-654e0cd9-e7b6-4df9-8900-7588a5bccda7 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:05.792342 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-654e0cd9-e7b6-4df9-8900-7588a5bccda7 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:05.894855 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-783bca30-da97-4af7-b2a4-51cfedee3e93 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:05.902347 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-783bca30-da97-4af7-b2a4-51cfedee3e93 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.155449 Jul 26 16:50:05.904915 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 630/1273] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:05 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:05.939838 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-654e0cd9-e7b6-4df9-8900-7588a5bccda7 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:05.948311 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-654e0cd9-e7b6-4df9-8900-7588a5bccda7 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1764 microversion: 2.1 time: 0.169182 Jul 26 16:50:05.948918 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 644/1274] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:05 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1764 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:50:06.923806 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d7ee41f7-aaac-4c2a-aacb-6b2f8fa097b5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:06.924506 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d7ee41f7-aaac-4c2a-aacb-6b2f8fa097b5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:06.930884 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d7ee41f7-aaac-4c2a-aacb-6b2f8fa097b5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:06.931336 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d7ee41f7-aaac-4c2a-aacb-6b2f8fa097b5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:06.932103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d7ee41f7-aaac-4c2a-aacb-6b2f8fa097b5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:06.932571 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d7ee41f7-aaac-4c2a-aacb-6b2f8fa097b5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:07.061909 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d7ee41f7-aaac-4c2a-aacb-6b2f8fa097b5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:07.069254 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d7ee41f7-aaac-4c2a-aacb-6b2f8fa097b5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.149911 Jul 26 16:50:07.069811 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 631/1275] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:06 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:08.091419 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-ea7430d3-aaf0-4b62-9afd-b19a5ea670d3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:08.091968 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-ea7430d3-aaf0-4b62-9afd-b19a5ea670d3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:08.098364 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea7430d3-aaf0-4b62-9afd-b19a5ea670d3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:08.098804 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea7430d3-aaf0-4b62-9afd-b19a5ea670d3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:08.099553 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea7430d3-aaf0-4b62-9afd-b19a5ea670d3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:08.099981 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-ea7430d3-aaf0-4b62-9afd-b19a5ea670d3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:08.232150 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-ea7430d3-aaf0-4b62-9afd-b19a5ea670d3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:08.239948 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-ea7430d3-aaf0-4b62-9afd-b19a5ea670d3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.152693 Jul 26 16:50:08.240682 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 645/1276] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:08 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:09.261594 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-d4308640-b7cc-426f-a227-c3a6dfc28c4f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:09.262208 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-d4308640-b7cc-426f-a227-c3a6dfc28c4f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:09.268763 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d4308640-b7cc-426f-a227-c3a6dfc28c4f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:09.269903 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d4308640-b7cc-426f-a227-c3a6dfc28c4f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:09.270532 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d4308640-b7cc-426f-a227-c3a6dfc28c4f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:09.270974 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-d4308640-b7cc-426f-a227-c3a6dfc28c4f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:09.402830 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-d4308640-b7cc-426f-a227-c3a6dfc28c4f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:09.410905 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-d4308640-b7cc-426f-a227-c3a6dfc28c4f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.153183 Jul 26 16:50:09.412685 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 632/1277] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:09 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:10.432249 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-c85ac9e2-2fbf-4099-9e07-9bae6bbe184b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:10.432868 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-c85ac9e2-2fbf-4099-9e07-9bae6bbe184b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:10.439314 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c85ac9e2-2fbf-4099-9e07-9bae6bbe184b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:10.439761 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c85ac9e2-2fbf-4099-9e07-9bae6bbe184b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:10.440549 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c85ac9e2-2fbf-4099-9e07-9bae6bbe184b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:10.440978 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-c85ac9e2-2fbf-4099-9e07-9bae6bbe184b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:10.449536 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-855f662d-5e40-4a9f-a9e3-5d3053f14488 req-84b70261-14f6-4905-a499-5def7318eeda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd36bc29-8c53-4965-96c9-26d3321bffbc", "name": "network-vif-plugged", "status": "completed", "tag": "7a0a4b81-bc50-4107-b252-2398b627a34c"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:50:10.459371 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-855f662d-5e40-4a9f-a9e3-5d3053f14488 req-84b70261-14f6-4905-a499-5def7318eeda service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:10.459808 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-855f662d-5e40-4a9f-a9e3-5d3053f14488 req-84b70261-14f6-4905-a499-5def7318eeda service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:10.477873 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-855f662d-5e40-4a9f-a9e3-5d3053f14488 req-84b70261-14f6-4905-a499-5def7318eeda service nova] Creating event network-vif-plugged:7a0a4b81-bc50-4107-b252-2398b627a34c for instance cd36bc29-8c53-4965-96c9-26d3321bffbc on hv-cinder-85104 Jul 26 16:50:10.483678 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-855f662d-5e40-4a9f-a9e3-5d3053f14488 req-84b70261-14f6-4905-a499-5def7318eeda service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091530 Jul 26 16:50:10.484545 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 646/1278] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:50:10.577293 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-c85ac9e2-2fbf-4099-9e07-9bae6bbe184b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:10.584851 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-c85ac9e2-2fbf-4099-9e07-9bae6bbe184b tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.156612 Jul 26 16:50:10.585408 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 633/1279] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:10 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:50:11.606395 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-db5eb2fc-0422-4746-ac04-f8d4cfb0feea tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:11.607203 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-db5eb2fc-0422-4746-ac04-f8d4cfb0feea tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:11.613339 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db5eb2fc-0422-4746-ac04-f8d4cfb0feea tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:11.613789 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db5eb2fc-0422-4746-ac04-f8d4cfb0feea tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:11.614554 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db5eb2fc-0422-4746-ac04-f8d4cfb0feea tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:11.614986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-db5eb2fc-0422-4746-ac04-f8d4cfb0feea tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:11.743873 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-db5eb2fc-0422-4746-ac04-f8d4cfb0feea tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:11.751862 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-db5eb2fc-0422-4746-ac04-f8d4cfb0feea tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1269 microversion: 2.1 time: 0.150180 Jul 26 16:50:11.752474 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 647/1280] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:11 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1269 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:12.773218 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-42b243c7-adf9-42fa-a24f-992f782b4b74 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:12.773739 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-42b243c7-adf9-42fa-a24f-992f782b4b74 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:12.780237 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-42b243c7-adf9-42fa-a24f-992f782b4b74 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:12.780720 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-42b243c7-adf9-42fa-a24f-992f782b4b74 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:12.781485 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-42b243c7-adf9-42fa-a24f-992f782b4b74 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:12.781924 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-42b243c7-adf9-42fa-a24f-992f782b4b74 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:12.914345 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-42b243c7-adf9-42fa-a24f-992f782b4b74 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:12.922390 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-42b243c7-adf9-42fa-a24f-992f782b4b74 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1457 microversion: 2.1 time: 0.153281 Jul 26 16:50:12.922982 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 634/1281] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:12 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1457 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:50:12.943975 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-516c2109-7dc0-4cb4-998e-ddea372a6f80 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:50:12.944603 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-516c2109-7dc0-4cb4-998e-ddea372a6f80 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:50:12.951073 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-516c2109-7dc0-4cb4-998e-ddea372a6f80 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:12.951515 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-516c2109-7dc0-4cb4-998e-ddea372a6f80 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:12.952270 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-516c2109-7dc0-4cb4-998e-ddea372a6f80 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:12.952729 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-516c2109-7dc0-4cb4-998e-ddea372a6f80 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:12.971006 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:50:13.084503 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-516c2109-7dc0-4cb4-998e-ddea372a6f80 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:50:13.091842 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-516c2109-7dc0-4cb4-998e-ddea372a6f80 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1457 microversion: 2.1 time: 0.151639 Jul 26 16:50:13.092468 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 648/1282] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:50:12 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1457 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:50:15.357251 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-ea0d0cd1-4c9d-4799-b1ad-43f54bae456b req-c7b59c68-a2e6-4f4f-952b-7a570dde67e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd36bc29-8c53-4965-96c9-26d3321bffbc", "tag": "7a0a4b81-bc50-4107-b252-2398b627a34c"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:50:15.367117 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-ea0d0cd1-4c9d-4799-b1ad-43f54bae456b req-c7b59c68-a2e6-4f4f-952b-7a570dde67e9 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:50:15.367645 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-ea0d0cd1-4c9d-4799-b1ad-43f54bae456b req-c7b59c68-a2e6-4f4f-952b-7a570dde67e9 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:50:15.378997 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-ea0d0cd1-4c9d-4799-b1ad-43f54bae456b req-c7b59c68-a2e6-4f4f-952b-7a570dde67e9 service nova] Creating event network-changed:7a0a4b81-bc50-4107-b252-2398b627a34c for instance cd36bc29-8c53-4965-96c9-26d3321bffbc on hv-cinder-85104 Jul 26 16:50:15.384277 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-ea0d0cd1-4c9d-4799-b1ad-43f54bae456b req-c7b59c68-a2e6-4f4f-952b-7a570dde67e9 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030820 Jul 26 16:50:15.385171 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 635/1283] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:51:01.596472 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 26 16:51:01.597025 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Tue Jul 26 16:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:51:07.915829 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:51:07.916473 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:51:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:51:09.598682 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-7e1a318d-57d4-4f91-97a3-b24f53180910 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-793294290"}} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:51:09.599163 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-7e1a318d-57d4-4f91-97a3-b24f53180910 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:09.601272 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=36 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:51:09.601954 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=2 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:51:09.606748 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7e1a318d-57d4-4f91-97a3-b24f53180910 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:09.614265 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7e1a318d-57d4-4f91-97a3-b24f53180910 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:09.614265 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7e1a318d-57d4-4f91-97a3-b24f53180910 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:09.614265 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-7e1a318d-57d4-4f91-97a3-b24f53180910 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:09.737439 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.network.security_group_api [None req-7e1a318d-57d4-4f91-97a3-b24f53180910 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Removing security group 5d52cb50-4801-421b-9581-b12f0aba3cf2 from port 47897c7d-52ee-4bd9-915e-f01b08aa844a Jul 26 16:51:10.143476 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-7e1a318d-57d4-4f91-97a3-b24f53180910 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "POST /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/action" status: 202 len: 0 microversion: 2.1 time: 0.548929 Jul 26 16:51:10.148549 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 649/1284] 10.222.0.144 () {60 vars in 1283 bytes} [Tue Jul 26 16:51:09 2022] POST /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:51:10.157846 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:51:10.159797 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=90 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:51:10.326391 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-2d80d7e3-7a89-4005-8c79-173fa8ec3bde req-9b1f8338-ef45-4151-81c0-5e495717356c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5531a6cc-8353-49bf-b227-655e10297753", "tag": "47897c7d-52ee-4bd9-915e-f01b08aa844a"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:51:10.338003 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-2d80d7e3-7a89-4005-8c79-173fa8ec3bde req-9b1f8338-ef45-4151-81c0-5e495717356c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:10.338546 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-2d80d7e3-7a89-4005-8c79-173fa8ec3bde req-9b1f8338-ef45-4151-81c0-5e495717356c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:10.356698 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-2d80d7e3-7a89-4005-8c79-173fa8ec3bde req-9b1f8338-ef45-4151-81c0-5e495717356c service nova] Creating event network-changed:47897c7d-52ee-4bd9-915e-f01b08aa844a for instance 5531a6cc-8353-49bf-b227-655e10297753 on hv-cinder-85104 Jul 26 16:51:10.356698 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-2d80d7e3-7a89-4005-8c79-173fa8ec3bde req-9b1f8338-ef45-4151-81c0-5e495717356c service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204503 Jul 26 16:51:10.358286 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 636/1285] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:51:11.333724 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-9d03cf47-6403-4d12-b0b7-847225a2d619 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:11.334789 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-9d03cf47-6403-4d12-b0b7-847225a2d619 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:11.335704 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-0ae24255-615e-4f4e-b1d0-22e325a228bd req-4912951e-e05f-49b9-b7ec-7d62c09fbff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5531a6cc-8353-49bf-b227-655e10297753", "tag": "47897c7d-52ee-4bd9-915e-f01b08aa844a"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:51:11.340995 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9d03cf47-6403-4d12-b0b7-847225a2d619 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:11.341450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9d03cf47-6403-4d12-b0b7-847225a2d619 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:11.342234 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9d03cf47-6403-4d12-b0b7-847225a2d619 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:11.342670 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-9d03cf47-6403-4d12-b0b7-847225a2d619 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:11.346689 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-0ae24255-615e-4f4e-b1d0-22e325a228bd req-4912951e-e05f-49b9-b7ec-7d62c09fbff1 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:11.347205 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-0ae24255-615e-4f4e-b1d0-22e325a228bd req-4912951e-e05f-49b9-b7ec-7d62c09fbff1 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:11.359210 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-0ae24255-615e-4f4e-b1d0-22e325a228bd req-4912951e-e05f-49b9-b7ec-7d62c09fbff1 service nova] Creating event network-changed:47897c7d-52ee-4bd9-915e-f01b08aa844a for instance 5531a6cc-8353-49bf-b227-655e10297753 on hv-cinder-85104 Jul 26 16:51:11.364671 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-0ae24255-615e-4f4e-b1d0-22e325a228bd req-4912951e-e05f-49b9-b7ec-7d62c09fbff1 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033080 Jul 26 16:51:11.366390 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 637/1286] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:51:11.437640 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-9d03cf47-6403-4d12-b0b7-847225a2d619 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lazy-loading 'services' on Instance uuid 5531a6cc-8353-49bf-b227-655e10297753 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:51:11.591450 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-9d03cf47-6403-4d12-b0b7-847225a2d619 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "DELETE /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments/901abcda-c13e-4d69-9b0f-c8e19c2c5870" status: 202 len: 0 microversion: 2.1 time: 0.262172 Jul 26 16:51:11.592905 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 650/1287] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:51:11 2022] DELETE /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments/901abcda-c13e-4d69-9b0f-c8e19c2c5870 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:51:11.604781 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-5656c9a3-860f-49c2-bcc7-5e4033856d47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:11.607887 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-5656c9a3-860f-49c2-bcc7-5e4033856d47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:11.615103 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5656c9a3-860f-49c2-bcc7-5e4033856d47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:11.616162 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5656c9a3-860f-49c2-bcc7-5e4033856d47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:11.617183 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5656c9a3-860f-49c2-bcc7-5e4033856d47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:11.618266 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-5656c9a3-860f-49c2-bcc7-5e4033856d47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:11.653354 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-5656c9a3-860f-49c2-bcc7-5e4033856d47 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055788 Jul 26 16:51:11.654550 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 638/1288] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:51:11 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:51:12.666860 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-61871686-4952-458e-8a26-695e887a2e1c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:12.669288 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-61871686-4952-458e-8a26-695e887a2e1c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:12.675601 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61871686-4952-458e-8a26-695e887a2e1c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:12.676045 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61871686-4952-458e-8a26-695e887a2e1c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:12.676826 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61871686-4952-458e-8a26-695e887a2e1c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:12.677254 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-61871686-4952-458e-8a26-695e887a2e1c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:12.705339 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-61871686-4952-458e-8a26-695e887a2e1c tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043575 Jul 26 16:51:12.705869 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 651/1289] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:51:12 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:51:13.718340 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-4968fa25-be93-4e63-83f9-ec1d5114acd3 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:13.720555 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-4968fa25-be93-4e63-83f9-ec1d5114acd3 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:13.727588 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4968fa25-be93-4e63-83f9-ec1d5114acd3 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:13.728036 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4968fa25-be93-4e63-83f9-ec1d5114acd3 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:13.728826 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4968fa25-be93-4e63-83f9-ec1d5114acd3 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:13.729263 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-4968fa25-be93-4e63-83f9-ec1d5114acd3 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:13.760542 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-4968fa25-be93-4e63-83f9-ec1d5114acd3 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046080 Jul 26 16:51:13.761093 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 639/1290] 10.222.0.144 () {58 vars in 1307 bytes} [Tue Jul 26 16:51:13 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 26 16:51:13.771449 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c486a401-ab93-49f2-bc34-02aab3e37c8a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:13.772520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c486a401-ab93-49f2-bc34-02aab3e37c8a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:13.778790 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c486a401-ab93-49f2-bc34-02aab3e37c8a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:13.779236 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c486a401-ab93-49f2-bc34-02aab3e37c8a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:13.779994 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c486a401-ab93-49f2-bc34-02aab3e37c8a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:13.780445 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c486a401-ab93-49f2-bc34-02aab3e37c8a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:13.853261 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-c486a401-ab93-49f2-bc34-02aab3e37c8a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] HTTP exception thrown: Instance 5531a6cc-8353-49bf-b227-655e10297753 is not attached to volume 901abcda-c13e-4d69-9b0f-c8e19c2c5870 Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c486a401-ab93-49f2-bc34-02aab3e37c8a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Request method failure captured: Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: DELETE /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments/901abcda-c13e-4d69-9b0f-c8e19c2c5870 HTTP/1.1 Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4Bqzeb3Wckz1ozlxGVvficUXgk8ijMnK_X5X3u3gtrr2sj0AGfUKixqsr969xozoN2RXtj-38hvlzef0VAVmp-kENllvtm7AFnQZvoMqzs6yOoeYgQEsEqMWsefy2MuEh1sfuPxyT0vc1OSAuk3jfoqi63PlSlshzc237d8pfvxblv8 Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 417fd6ab3a0c4537a10272ee14f1cadb Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-TestMinimumBasicScenario-1344268568 Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:51:13.855614 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/417fd6ab3a0c4537a10272ee14f1cadb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/417fd6ab3a0c4537a10272ee14f1cadb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/417fd6ab3a0c4537a10272ee14f1cadb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_417fd6ab3a0c4537a10272ee14f1cadb", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-TestMinimumBasicScenario-1344268568 Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 417fd6ab3a0c4537a10272ee14f1cadb Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1344268568 Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-TestMinimumBasicScenario-1344268568-project Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: e57b5c97a19a42c28156f1fc82384fc1 Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-TestMinimumBasicScenario-1344268568-project Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:51:13.857420 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 5531a6cc-8353-49bf-b227-655e10297753 is not attached to volume 901abcda-c13e-4d69-9b0f-c8e19c2c5870 Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'server_id': '5531a6cc-8353-49bf-b227-655e10297753', 'id': '901abcda-c13e-4d69-9b0f-c8e19c2c5870'} Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 901abcda-c13e-4d69-9b0f-c8e19c2c5870. Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:51:13.858429 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5531a6cc-8353-49bf-b227-655e10297753 is not attached to volume 901abcda-c13e-4d69-9b0f-c8e19c2c5870 Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5531a6cc-8353-49bf-b227-655e10297753 is not attached to volume 901abcda-c13e-4d69-9b0f-c8e19c2c5870 Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:51:13.860090 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c486a401-ab93-49f2-bc34-02aab3e37c8a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Returning 404 to user: Instance 5531a6cc-8353-49bf-b227-655e10297753 is not attached to volume 901abcda-c13e-4d69-9b0f-c8e19c2c5870 {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:51:13.861375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c486a401-ab93-49f2-bc34-02aab3e37c8a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "DELETE /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments/901abcda-c13e-4d69-9b0f-c8e19c2c5870" status: 404 len: 154 microversion: 2.1 time: 0.089576 Jul 26 16:51:13.861375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 652/1291] 10.222.0.144 () {58 vars in 1421 bytes} [Tue Jul 26 16:51:13 2022] DELETE /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753/os-volume_attachments/901abcda-c13e-4d69-9b0f-c8e19c2c5870 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:51:15.190528 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-6e8996cb-5375-429f-a977-bf85a3551f0a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:15.200504 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6e8996cb-5375-429f-a977-bf85a3551f0a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:15.200504 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6e8996cb-5375-429f-a977-bf85a3551f0a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:15.200504 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6e8996cb-5375-429f-a977-bf85a3551f0a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:15.200504 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6e8996cb-5375-429f-a977-bf85a3551f0a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:15.200917 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-6e8996cb-5375-429f-a977-bf85a3551f0a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:15.224891 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-6e8996cb-5375-429f-a977-bf85a3551f0a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:51:15.517133 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-6e8996cb-5375-429f-a977-bf85a3551f0a tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "DELETE /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 204 len: 0 microversion: 2.1 time: 0.330055 Jul 26 16:51:15.517722 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 640/1292] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:51:15 2022] DELETE /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:51:15.526462 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-0d423b50-f80d-48f1-8bb8-f277f89ddc06 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:15.527072 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-0d423b50-f80d-48f1-8bb8-f277f89ddc06 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:15.534470 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0d423b50-f80d-48f1-8bb8-f277f89ddc06 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:15.534695 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0d423b50-f80d-48f1-8bb8-f277f89ddc06 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:15.535487 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0d423b50-f80d-48f1-8bb8-f277f89ddc06 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:15.535933 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-0d423b50-f80d-48f1-8bb8-f277f89ddc06 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:15.668839 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-0d423b50-f80d-48f1-8bb8-f277f89ddc06 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:51:15.676375 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-0d423b50-f80d-48f1-8bb8-f277f89ddc06 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1559 microversion: 2.1 time: 0.154284 Jul 26 16:51:15.676956 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 653/1293] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:51:15 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:51:16.698443 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8d63c408-4371-4cbf-8faf-d5698a55083e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:16.699163 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8d63c408-4371-4cbf-8faf-d5698a55083e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:16.705631 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8d63c408-4371-4cbf-8faf-d5698a55083e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:16.706081 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8d63c408-4371-4cbf-8faf-d5698a55083e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:16.706843 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8d63c408-4371-4cbf-8faf-d5698a55083e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:16.707273 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8d63c408-4371-4cbf-8faf-d5698a55083e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:16.833055 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8d63c408-4371-4cbf-8faf-d5698a55083e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:51:16.841019 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8d63c408-4371-4cbf-8faf-d5698a55083e tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1559 microversion: 2.1 time: 0.146819 Jul 26 16:51:16.841564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 641/1294] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:51:16 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:51:17.861763 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-a9f49f91-1c5f-412b-9668-e354f63fbe17 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:17.862354 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-a9f49f91-1c5f-412b-9668-e354f63fbe17 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:17.869703 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9f49f91-1c5f-412b-9668-e354f63fbe17 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:17.870143 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9f49f91-1c5f-412b-9668-e354f63fbe17 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:17.870977 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9f49f91-1c5f-412b-9668-e354f63fbe17 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:17.871406 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-a9f49f91-1c5f-412b-9668-e354f63fbe17 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:18.110703 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-a9f49f91-1c5f-412b-9668-e354f63fbe17 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:51:18.119640 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-a9f49f91-1c5f-412b-9668-e354f63fbe17 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1559 microversion: 2.1 time: 0.261714 Jul 26 16:51:18.120520 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 654/1295] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:51:17 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1559 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:51:18.446159 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [req-fc512e45-d238-40f2-8bef-e8b87354d100 req-225e713f-0d1b-4c87-b900-7f02bbcd3552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5531a6cc-8353-49bf-b227-655e10297753", "name": "network-vif-deleted", "tag": "47897c7d-52ee-4bd9-915e-f01b08aa844a"}]} {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:51:18.456255 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-fc512e45-d238-40f2-8bef-e8b87354d100 req-225e713f-0d1b-4c87-b900-7f02bbcd3552 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:18.456771 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [req-fc512e45-d238-40f2-8bef-e8b87354d100 req-225e713f-0d1b-4c87-b900-7f02bbcd3552 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:18.468197 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.compute.server_external_events [req-fc512e45-d238-40f2-8bef-e8b87354d100 req-225e713f-0d1b-4c87-b900-7f02bbcd3552 service nova] Creating event network-vif-deleted:47897c7d-52ee-4bd9-915e-f01b08aa844a for instance 5531a6cc-8353-49bf-b227-655e10297753 on hv-cinder-85104 Jul 26 16:51:18.473260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [req-fc512e45-d238-40f2-8bef-e8b87354d100 req-225e713f-0d1b-4c87-b900-7f02bbcd3552 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030693 Jul 26 16:51:18.474191 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 642/1296] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:51:19.141719 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:19.142330 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:19.149414 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:19.149860 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:19.150630 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:19.151067 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:19.181213 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:19.181659 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:19.182110 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lazy-loading 'fault' on Instance uuid 5531a6cc-8353-49bf-b227-655e10297753 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:51:19.222294 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e57b5c97a19a42c28156f1fc82384fc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '417fd6ab3a0c4537a10272ee14f1cadb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:51:19.230333 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-978212b7-7f79-4977-abb7-7c4d04da5b45 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 200 len: 1352 microversion: 2.1 time: 0.094210 Jul 26 16:51:19.230898 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 655/1297] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:51:19 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:51:20.252260 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e53f2d04-7f16-4f86-84a6-e2ef25933e0f tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:20.252990 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-e53f2d04-7f16-4f86-84a6-e2ef25933e0f tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] [instance: 5531a6cc-8353-49bf-b227-655e10297753] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:51:20.259203 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e53f2d04-7f16-4f86-84a6-e2ef25933e0f tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:20.259653 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e53f2d04-7f16-4f86-84a6-e2ef25933e0f tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:20.260448 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e53f2d04-7f16-4f86-84a6-e2ef25933e0f tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:51:20.260893 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-e53f2d04-7f16-4f86-84a6-e2ef25933e0f tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:51:20.274015 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-e53f2d04-7f16-4f86-84a6-e2ef25933e0f tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] HTTP exception thrown: Instance 5531a6cc-8353-49bf-b227-655e10297753 could not be found. Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e53f2d04-7f16-4f86-84a6-e2ef25933e0f tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Request method failure captured: Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 HTTP/1.1 Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4Bqzeb3Wckz1ozlxGVvficUXgk8ijMnK_X5X3u3gtrr2sj0AGfUKixqsr969xozoN2RXtj-38hvlzef0VAVmp-kENllvtm7AFnQZvoMqzs6yOoeYgQEsEqMWsefy2MuEh1sfuPxyT0vc1OSAuk3jfoqi63PlSlshzc237d8pfvxblv8 Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 417fd6ab3a0c4537a10272ee14f1cadb Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-TestMinimumBasicScenario-1344268568 Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:51:20.275676 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/417fd6ab3a0c4537a10272ee14f1cadb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/417fd6ab3a0c4537a10272ee14f1cadb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/417fd6ab3a0c4537a10272ee14f1cadb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_417fd6ab3a0c4537a10272ee14f1cadb", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-TestMinimumBasicScenario-1344268568 Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 417fd6ab3a0c4537a10272ee14f1cadb Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1344268568 Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-TestMinimumBasicScenario-1344268568-project Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: e57b5c97a19a42c28156f1fc82384fc1 Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-TestMinimumBasicScenario-1344268568-project Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 5531a6cc-8353-49bf-b227-655e10297753 could not be found. Jul 26 16:51:20.277494 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '5531a6cc-8353-49bf-b227-655e10297753'} Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5531a6cc-8353-49bf-b227-655e10297753 could not be found. Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:51:20.278626 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5531a6cc-8353-49bf-b227-655e10297753 could not be found. Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5531a6cc-8353-49bf-b227-655e10297753 could not be found. Jul 26 16:51:20.280510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:51:20.282124 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-e53f2d04-7f16-4f86-84a6-e2ef25933e0f tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Returning 404 to user: Instance 5531a6cc-8353-49bf-b227-655e10297753 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:51:20.282124 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-e53f2d04-7f16-4f86-84a6-e2ef25933e0f tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753" status: 404 len: 111 microversion: 2.1 time: 0.029675 Jul 26 16:51:20.282124 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 643/1298] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:51:20 2022] GET /compute/v2.1/servers/5531a6cc-8353-49bf-b227-655e10297753 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:51:20.287817 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-6266a571-7f8e-4963-9a2e-aa9755f9d429 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] Calling method '.version_select at 0x7f4b6c1e1670>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:51:20.432068 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-6266a571-7f8e-4963-9a2e-aa9755f9d429 tempest-TestMinimumBasicScenario-1344268568 tempest-TestMinimumBasicScenario-1344268568-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-366545046" status: 202 len: 0 microversion: 2.1 time: 0.148424 Jul 26 16:51:20.432670 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 656/1299] 10.222.0.144 () {58 vars in 1274 bytes} [Tue Jul 26 16:51:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-366545046 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:52:06.177967 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8d57046a-a2af-4271-a909-91806d8126be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:06.178609 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:52:06.178979 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8d57046a-a2af-4271-a909-91806d8126be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:06.179828 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG dbcounter [-] [124821] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124821) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:52:06.181907 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:52:06.182681 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG dbcounter [-] [124820] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124820) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 16:52:06.184239 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-1f83a156-79a7-4ea1-bc5a-34fb330ac3a7 req-f313f444-af99-4c99-8b58-4ecac4579e88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd36bc29-8c53-4965-96c9-26d3321bffbc", "tag": "7a0a4b81-bc50-4107-b252-2398b627a34c"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:52:06.186363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8d57046a-a2af-4271-a909-91806d8126be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:06.186810 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8d57046a-a2af-4271-a909-91806d8126be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:06.187606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8d57046a-a2af-4271-a909-91806d8126be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:06.188035 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8d57046a-a2af-4271-a909-91806d8126be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:06.195035 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-1f83a156-79a7-4ea1-bc5a-34fb330ac3a7 req-f313f444-af99-4c99-8b58-4ecac4579e88 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:06.195569 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-1f83a156-79a7-4ea1-bc5a-34fb330ac3a7 req-f313f444-af99-4c99-8b58-4ecac4579e88 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:06.206209 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-1f83a156-79a7-4ea1-bc5a-34fb330ac3a7 req-f313f444-af99-4c99-8b58-4ecac4579e88 service nova] Creating event network-changed:7a0a4b81-bc50-4107-b252-2398b627a34c for instance cd36bc29-8c53-4965-96c9-26d3321bffbc on hv-cinder-85104 Jul 26 16:52:06.212080 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-1f83a156-79a7-4ea1-bc5a-34fb330ac3a7 req-f313f444-af99-4c99-8b58-4ecac4579e88 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035007 Jul 26 16:52:06.213014 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 657/1300] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 26 16:52:06.214934 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8d57046a-a2af-4271-a909-91806d8126be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:52:06.535563 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8d57046a-a2af-4271-a909-91806d8126be tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "DELETE /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 204 len: 0 microversion: 2.1 time: 0.360939 Jul 26 16:52:06.536907 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 644/1301] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:52:06 2022] DELETE /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:52:06.547832 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-3082e9db-589f-4c05-a5ce-d95fc9d986ef tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:06.548626 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-3082e9db-589f-4c05-a5ce-d95fc9d986ef tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:06.556643 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3082e9db-589f-4c05-a5ce-d95fc9d986ef tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:06.557094 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3082e9db-589f-4c05-a5ce-d95fc9d986ef tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:06.557865 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3082e9db-589f-4c05-a5ce-d95fc9d986ef tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:06.558422 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-3082e9db-589f-4c05-a5ce-d95fc9d986ef tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:06.690061 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-3082e9db-589f-4c05-a5ce-d95fc9d986ef tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:52:06.697759 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-3082e9db-589f-4c05-a5ce-d95fc9d986ef tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1582 microversion: 2.1 time: 0.155686 Jul 26 16:52:06.698330 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 658/1302] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:52:06 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1582 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:52:07.719606 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-eede057c-6ee1-46aa-8e3d-f3349a6a2cdc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:07.720305 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-eede057c-6ee1-46aa-8e3d-f3349a6a2cdc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:07.728086 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eede057c-6ee1-46aa-8e3d-f3349a6a2cdc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:07.728561 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eede057c-6ee1-46aa-8e3d-f3349a6a2cdc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:07.729327 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eede057c-6ee1-46aa-8e3d-f3349a6a2cdc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:07.729816 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-eede057c-6ee1-46aa-8e3d-f3349a6a2cdc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:07.865212 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-eede057c-6ee1-46aa-8e3d-f3349a6a2cdc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:52:07.873995 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-eede057c-6ee1-46aa-8e3d-f3349a6a2cdc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1582 microversion: 2.1 time: 0.158563 Jul 26 16:52:07.874564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 645/1303] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:52:07 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1582 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:52:08.793764 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-ab58702e-695d-48c6-9073-c22408f8f141 req-89748155-0e95-4a68-80b9-b1df982c2668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd36bc29-8c53-4965-96c9-26d3321bffbc", "name": "network-vif-deleted", "tag": "7a0a4b81-bc50-4107-b252-2398b627a34c"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:52:08.804307 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-ab58702e-695d-48c6-9073-c22408f8f141 req-89748155-0e95-4a68-80b9-b1df982c2668 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:08.804773 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-ab58702e-695d-48c6-9073-c22408f8f141 req-89748155-0e95-4a68-80b9-b1df982c2668 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:08.815380 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-ab58702e-695d-48c6-9073-c22408f8f141 req-89748155-0e95-4a68-80b9-b1df982c2668 service nova] Creating event network-vif-deleted:7a0a4b81-bc50-4107-b252-2398b627a34c for instance cd36bc29-8c53-4965-96c9-26d3321bffbc on hv-cinder-85104 Jul 26 16:52:08.820275 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-ab58702e-695d-48c6-9073-c22408f8f141 req-89748155-0e95-4a68-80b9-b1df982c2668 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030138 Jul 26 16:52:08.829780 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 659/1304] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:52:08.895087 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-8e6ceebf-ec22-4e00-8d5c-c707e5641bc3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:08.895731 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-8e6ceebf-ec22-4e00-8d5c-c707e5641bc3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:08.902797 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e6ceebf-ec22-4e00-8d5c-c707e5641bc3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:08.903251 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e6ceebf-ec22-4e00-8d5c-c707e5641bc3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:08.904020 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e6ceebf-ec22-4e00-8d5c-c707e5641bc3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:08.904490 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-8e6ceebf-ec22-4e00-8d5c-c707e5641bc3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:08.971686 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-8e6ceebf-ec22-4e00-8d5c-c707e5641bc3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:52:08.979199 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-8e6ceebf-ec22-4e00-8d5c-c707e5641bc3 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 200 len: 1395 microversion: 2.1 time: 0.088038 Jul 26 16:52:08.979755 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 646/1305] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:52:08 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 1395 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:52:10.243289 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-716a0f6c-aabb-4f8a-b0e5-77fe380b29fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:10.243996 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-716a0f6c-aabb-4f8a-b0e5-77fe380b29fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: cd36bc29-8c53-4965-96c9-26d3321bffbc] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:10.250905 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-716a0f6c-aabb-4f8a-b0e5-77fe380b29fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:10.256585 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-716a0f6c-aabb-4f8a-b0e5-77fe380b29fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:10.256585 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-716a0f6c-aabb-4f8a-b0e5-77fe380b29fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:10.256585 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-716a0f6c-aabb-4f8a-b0e5-77fe380b29fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:10.265930 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-716a0f6c-aabb-4f8a-b0e5-77fe380b29fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] HTTP exception thrown: Instance cd36bc29-8c53-4965-96c9-26d3321bffbc could not be found. Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-716a0f6c-aabb-4f8a-b0e5-77fe380b29fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Request method failure captured: Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc HTTP/1.1 Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BlZvxVrb4OfRcJkWMTX19c9_7gPhzahY1kGdUs26uuEVFoIYeeKz5kGOgO2MdpUgL8OGkryzPn9Evs-OYjcEL6-Q3J0hWYj6-1dq4V-JttY1pNZHmAlt4sABEPGBhxLkrVpqX0zkWZbyMwMhUEU8oLSire629LQ8UMsTGltH8votx0 Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 94684df47fe14e55af2e72ab5d2ddc48 Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:52:10.267787 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_94684df47fe14e55af2e72ab5d2ddc48", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 94684df47fe14e55af2e72ab5d2ddc48 Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-TestVolumeBootPattern-165332593-project Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: ea4ccbb465094f079dcc4ca3bcac59cb Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-TestVolumeBootPattern-165332593-project Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance cd36bc29-8c53-4965-96c9-26d3321bffbc could not be found. Jul 26 16:52:10.269441 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': 'cd36bc29-8c53-4965-96c9-26d3321bffbc'} Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd36bc29-8c53-4965-96c9-26d3321bffbc could not be found. Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:52:10.270341 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd36bc29-8c53-4965-96c9-26d3321bffbc could not be found. Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd36bc29-8c53-4965-96c9-26d3321bffbc could not be found. Jul 26 16:52:10.271819 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:52:10.274569 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-716a0f6c-aabb-4f8a-b0e5-77fe380b29fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Returning 404 to user: Instance cd36bc29-8c53-4965-96c9-26d3321bffbc could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:52:10.274569 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-716a0f6c-aabb-4f8a-b0e5-77fe380b29fc tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc" status: 404 len: 111 microversion: 2.1 time: 0.272084 Jul 26 16:52:10.274569 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 660/1306] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:52:09 2022] GET /compute/v2.1/servers/cd36bc29-8c53-4965-96c9-26d3321bffbc => generated 111 bytes in 274 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:52:13.655112 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-467d8e6c-fd46-4744-9b80-f8597c24f8ce tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:13.655633 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-467d8e6c-fd46-4744-9b80-f8597c24f8ce tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:13.657641 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-5665a249-ed4f-4b74-93bf-31d2494a06d4 req-e3241902-f0e2-4e84-bd21-57d1c3386233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9f07c88-96f8-48c2-8523-be0e7981ee79", "tag": "ebc7fc3d-47c6-4726-9b7f-a4a4e8468fe2"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:52:13.662437 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-467d8e6c-fd46-4744-9b80-f8597c24f8ce tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:13.662981 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-467d8e6c-fd46-4744-9b80-f8597c24f8ce tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:13.663999 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-467d8e6c-fd46-4744-9b80-f8597c24f8ce tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:13.664953 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-467d8e6c-fd46-4744-9b80-f8597c24f8ce tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:13.668362 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-5665a249-ed4f-4b74-93bf-31d2494a06d4 req-e3241902-f0e2-4e84-bd21-57d1c3386233 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:13.669670 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-5665a249-ed4f-4b74-93bf-31d2494a06d4 req-e3241902-f0e2-4e84-bd21-57d1c3386233 service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:13.680937 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-5665a249-ed4f-4b74-93bf-31d2494a06d4 req-e3241902-f0e2-4e84-bd21-57d1c3386233 service nova] Creating event network-changed:ebc7fc3d-47c6-4726-9b7f-a4a4e8468fe2 for instance e9f07c88-96f8-48c2-8523-be0e7981ee79 on hv-cinder-85104 Jul 26 16:52:13.686031 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-5665a249-ed4f-4b74-93bf-31d2494a06d4 req-e3241902-f0e2-4e84-bd21-57d1c3386233 service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033235 Jul 26 16:52:13.686858 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 661/1307] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:52:13.690363 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-467d8e6c-fd46-4744-9b80-f8597c24f8ce tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Going to try to terminate instance {{(pid=124820) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 26 16:52:14.104958 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-467d8e6c-fd46-4744-9b80-f8597c24f8ce tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "DELETE /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 204 len: 0 microversion: 2.1 time: 0.454036 Jul 26 16:52:14.105532 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 647/1308] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:52:13 2022] DELETE /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 26 16:52:14.114198 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-c48c7bfe-16b6-4301-8a00-8c77f647d78f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:14.114902 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-c48c7bfe-16b6-4301-8a00-8c77f647d78f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:14.135924 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c48c7bfe-16b6-4301-8a00-8c77f647d78f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:14.135924 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c48c7bfe-16b6-4301-8a00-8c77f647d78f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:14.135924 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c48c7bfe-16b6-4301-8a00-8c77f647d78f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:14.135924 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-c48c7bfe-16b6-4301-8a00-8c77f647d78f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:14.258986 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-c48c7bfe-16b6-4301-8a00-8c77f647d78f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:52:14.267314 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-c48c7bfe-16b6-4301-8a00-8c77f647d78f tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1582 microversion: 2.1 time: 0.157196 Jul 26 16:52:14.269169 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 662/1309] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:52:14 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1582 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:52:15.288491 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-b542fcf6-ff4e-4ffc-a58c-d0f8e9f6858a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:15.289485 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-b542fcf6-ff4e-4ffc-a58c-d0f8e9f6858a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:15.296022 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b542fcf6-ff4e-4ffc-a58c-d0f8e9f6858a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:15.296509 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b542fcf6-ff4e-4ffc-a58c-d0f8e9f6858a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:15.297284 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b542fcf6-ff4e-4ffc-a58c-d0f8e9f6858a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:15.297730 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-b542fcf6-ff4e-4ffc-a58c-d0f8e9f6858a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:15.432176 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-b542fcf6-ff4e-4ffc-a58c-d0f8e9f6858a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:52:15.440199 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-b542fcf6-ff4e-4ffc-a58c-d0f8e9f6858a tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1582 microversion: 2.1 time: 0.156022 Jul 26 16:52:15.440797 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 648/1310] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:52:15 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1582 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:52:16.437529 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [req-db8ffd7e-e677-4a31-8f05-e461904e586c req-f98ff501-d54a-4e31-8982-f946a4bcaf5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9f07c88-96f8-48c2-8523-be0e7981ee79", "name": "network-vif-deleted", "tag": "ebc7fc3d-47c6-4726-9b7f-a4a4e8468fe2"}]} {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 26 16:52:16.447456 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-db8ffd7e-e677-4a31-8f05-e461904e586c req-f98ff501-d54a-4e31-8982-f946a4bcaf5c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:16.447896 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [req-db8ffd7e-e677-4a31-8f05-e461904e586c req-f98ff501-d54a-4e31-8982-f946a4bcaf5c service nova] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:16.458684 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.compute.server_external_events [req-db8ffd7e-e677-4a31-8f05-e461904e586c req-f98ff501-d54a-4e31-8982-f946a4bcaf5c service nova] Creating event network-vif-deleted:ebc7fc3d-47c6-4726-9b7f-a4a4e8468fe2 for instance e9f07c88-96f8-48c2-8523-be0e7981ee79 on hv-cinder-85104 Jul 26 16:52:16.460800 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-859ea362-08b5-4620-8737-99bfbe45a6eb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:16.461454 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-859ea362-08b5-4620-8737-99bfbe45a6eb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:16.463766 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [req-db8ffd7e-e677-4a31-8f05-e461904e586c req-f98ff501-d54a-4e31-8982-f946a4bcaf5c service nova] 10.222.0.144 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030548 Jul 26 16:52:16.464376 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 663/1311] 10.222.0.144 () {64 vars in 1322 bytes} [Tue Jul 26 16:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 26 16:52:16.468966 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-859ea362-08b5-4620-8737-99bfbe45a6eb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:16.469421 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-859ea362-08b5-4620-8737-99bfbe45a6eb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:16.471011 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-859ea362-08b5-4620-8737-99bfbe45a6eb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:16.471011 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-859ea362-08b5-4620-8737-99bfbe45a6eb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:16.533552 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.policy [None req-859ea362-08b5-4620-8737-99bfbe45a6eb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124820) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:52:16.541424 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-859ea362-08b5-4620-8737-99bfbe45a6eb tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1395 microversion: 2.1 time: 0.084505 Jul 26 16:52:16.542013 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 649/1312] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:52:16 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1395 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 26 16:52:17.563963 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:17.564686 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:17.570933 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:17.571383 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:17.572206 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:17.572696 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:17.603479 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:17.603854 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:17.604301 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.objects.instance [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lazy-loading 'fault' on Instance uuid e9f07c88-96f8-48c2-8523-be0e7981ee79 {{(pid=124821) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 26 16:52:17.645723 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.policy [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea4ccbb465094f079dcc4ca3bcac59cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94684df47fe14e55af2e72ab5d2ddc48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124821) authorize /opt/stack/nova/nova/policy.py:199}} Jul 26 16:52:17.653242 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-74d4ed8e-afda-46e0-9826-8329b97eb465 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 200 len: 1233 microversion: 2.1 time: 0.093930 Jul 26 16:52:17.656526 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 664/1313] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:52:17 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 1233 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 26 16:52:18.674993 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-37adf1ca-1627-497e-bdc5-451272497907 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:18.675603 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-37adf1ca-1627-497e-bdc5-451272497907 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: e9f07c88-96f8-48c2-8523-be0e7981ee79] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:18.682058 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37adf1ca-1627-497e-bdc5-451272497907 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:18.682510 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37adf1ca-1627-497e-bdc5-451272497907 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:18.683268 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37adf1ca-1627-497e-bdc5-451272497907 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:18.683706 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-37adf1ca-1627-497e-bdc5-451272497907 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:18.697936 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-37adf1ca-1627-497e-bdc5-451272497907 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] HTTP exception thrown: Instance e9f07c88-96f8-48c2-8523-be0e7981ee79 could not be found. Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-37adf1ca-1627-497e-bdc5-451272497907 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Request method failure captured: Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 HTTP/1.1 Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BlZvxVrb4OfRcJkWMTX19c9_7gPhzahY1kGdUs26uuEVFoIYeeKz5kGOgO2MdpUgL8OGkryzPn9Evs-OYjcEL6-Q3J0hWYj6-1dq4V-JttY1pNZHmAlt4sABEPGBhxLkrVpqX0zkWZbyMwMhUEU8oLSire629LQ8UMsTGltH8votx0 Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 94684df47fe14e55af2e72ab5d2ddc48 Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:52:18.701757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_94684df47fe14e55af2e72ab5d2ddc48", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 94684df47fe14e55af2e72ab5d2ddc48 Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-TestVolumeBootPattern-165332593-project Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: ea4ccbb465094f079dcc4ca3bcac59cb Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-TestVolumeBootPattern-165332593-project Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance e9f07c88-96f8-48c2-8523-be0e7981ee79 could not be found. Jul 26 16:52:18.703502 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': 'e9f07c88-96f8-48c2-8523-be0e7981ee79'} Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9f07c88-96f8-48c2-8523-be0e7981ee79 could not be found. Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:52:18.704708 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9f07c88-96f8-48c2-8523-be0e7981ee79 could not be found. Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9f07c88-96f8-48c2-8523-be0e7981ee79 could not be found. Jul 26 16:52:18.706325 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:52:18.707827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-37adf1ca-1627-497e-bdc5-451272497907 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Returning 404 to user: Instance e9f07c88-96f8-48c2-8523-be0e7981ee79 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:52:18.707827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-37adf1ca-1627-497e-bdc5-451272497907 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79" status: 404 len: 111 microversion: 2.1 time: 0.032078 Jul 26 16:52:18.707827 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 650/1314] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:52:18 2022] GET /compute/v2.1/servers/e9f07c88-96f8-48c2-8523-be0e7981ee79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:52:19.230670 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5d204877-f110-423b-baf9-7023fe8ebaff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:19.231201 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.compute.api [None req-5d204877-f110-423b-baf9-7023fe8ebaff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124821) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:19.238321 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d204877-f110-423b-baf9-7023fe8ebaff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:19.238765 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d204877-f110-423b-baf9-7023fe8ebaff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:19.239743 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d204877-f110-423b-baf9-7023fe8ebaff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:19.240172 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG oslo_concurrency.lockutils [None req-5d204877-f110-423b-baf9-7023fe8ebaff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124821) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:19.253915 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.wsgi [None req-5d204877-f110-423b-baf9-7023fe8ebaff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] HTTP exception thrown: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5d204877-f110-423b-baf9-7023fe8ebaff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Request method failure captured: Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: request: DELETE /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 HTTP/1.1 Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept: application/json Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Accept-Encoding: identity Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Connection: close Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Length: 0 Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Content-Type: application/json Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Host: 10.222.0.144 Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Openstack-System-Scope: None Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: User-Agent: python-urllib3/1.26.10 Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Auth-Token: gAAAAABi4BlZvxVrb4OfRcJkWMTX19c9_7gPhzahY1kGdUs26uuEVFoIYeeKz5kGOgO2MdpUgL8OGkryzPn9Evs-OYjcEL6-Q3J0hWYj6-1dq4V-JttY1pNZHmAlt4sABEPGBhxLkrVpqX0zkWZbyMwMhUEU8oLSire629LQ8UMsTGltH8votx0 Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Id: None Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Domain-Name: None Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Identity-Status: Confirmed Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Is-Admin-Project: True Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Id: default Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Domain-Name: Default Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Id: 94684df47fe14e55af2e72ab5d2ddc48 Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Project-Name: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Role: member,reader Jul 26 16:52:19.257574 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Roles: member,reader Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_94684df47fe14e55af2e72ab5d2ddc48", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Id: 94684df47fe14e55af2e72ab5d2ddc48 Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-Tenant-Name: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User: tempest-TestVolumeBootPattern-165332593-project Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Id: default Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Domain-Name: Default Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Id: ea4ccbb465094f079dcc4ca3bcac59cb Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: X-User-Name: tempest-TestVolumeBootPattern-165332593-project Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: method: > Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: exception: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:52:19.259332 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: action_args: {'id': '608fc7e4-4ccf-4823-82af-392b80004b29'} Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:52:19.260331 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:52:19.262023 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: ERROR nova.api.openstack.wsgi Jul 26 16:52:19.263683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-5d204877-f110-423b-baf9-7023fe8ebaff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Returning 404 to user: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. {{(pid=124821) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:52:19.263683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-5d204877-f110-423b-baf9-7023fe8ebaff tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "DELETE /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 404 len: 111 microversion: 2.1 time: 0.030205 Jul 26 16:52:19.263683 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 665/1315] 10.222.0.144 () {58 vars in 1244 bytes} [Tue Jul 26 16:52:19 2022] DELETE /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:52:19.265655 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3bf683c5-b148-4eb3-b185-7bd5b6cf7005 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '>' {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:19.266276 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.compute.api [None req-3bf683c5-b148-4eb3-b185-7bd5b6cf7005 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] [instance: 608fc7e4-4ccf-4823-82af-392b80004b29] Fetching instance by UUID {{(pid=124820) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 26 16:52:19.272178 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3bf683c5-b148-4eb3-b185-7bd5b6cf7005 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:19.272663 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3bf683c5-b148-4eb3-b185-7bd5b6cf7005 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:19.273423 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3bf683c5-b148-4eb3-b185-7bd5b6cf7005 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 26 16:52:19.273860 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG oslo_concurrency.lockutils [None req-3bf683c5-b148-4eb3-b185-7bd5b6cf7005 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Lock "499fcfc6-ab87-45d5-8d28-bf683a10ff8a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124820) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 26 16:52:19.287211 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.wsgi [None req-3bf683c5-b148-4eb3-b185-7bd5b6cf7005 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] HTTP exception thrown: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3bf683c5-b148-4eb3-b185-7bd5b6cf7005 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Request method failure captured: Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: request: GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 HTTP/1.1 Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept: application/json Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Accept-Encoding: identity Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Connection: close Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Length: 0 Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Content-Type: application/json Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Host: 10.222.0.144 Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Openstack-System-Scope: None Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: User-Agent: python-urllib3/1.26.10 Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Auth-Token: gAAAAABi4BlZvxVrb4OfRcJkWMTX19c9_7gPhzahY1kGdUs26uuEVFoIYeeKz5kGOgO2MdpUgL8OGkryzPn9Evs-OYjcEL6-Q3J0hWYj6-1dq4V-JttY1pNZHmAlt4sABEPGBhxLkrVpqX0zkWZbyMwMhUEU8oLSire629LQ8UMsTGltH8votx0 Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Id: None Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Domain-Name: None Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Identity-Status: Confirmed Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Is-Admin-Project: True Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Id: default Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Domain-Name: Default Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Id: 94684df47fe14e55af2e72ab5d2ddc48 Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Project-Name: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Role: member,reader Jul 26 16:52:19.288757 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Roles: member,reader Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/compute/v2/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/volume/v3/94684df47fe14e55af2e72ab5d2ddc48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144:8080/v1/AUTH_94684df47fe14e55af2e72ab5d2ddc48", "adminURL": "http://10.222.0.144:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.144/placement"}]}] Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Id: 94684df47fe14e55af2e72ab5d2ddc48 Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-Tenant-Name: tempest-TestVolumeBootPattern-165332593 Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User: tempest-TestVolumeBootPattern-165332593-project Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Id: default Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Domain-Name: Default Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Id: ea4ccbb465094f079dcc4ca3bcac59cb Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: X-User-Name: tempest-TestVolumeBootPattern-165332593-project Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: method: > Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: exception: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:52:19.290819 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: action_args: {'id': '608fc7e4-4ccf-4823-82af-392b80004b29'} Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: {{(pid=124820) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 26 16:52:19.295564 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. Jul 26 16:52:19.297252 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: ERROR nova.api.openstack.wsgi Jul 26 16:52:19.299220 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: DEBUG nova.api.openstack.wsgi [None req-3bf683c5-b148-4eb3-b185-7bd5b6cf7005 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Returning 404 to user: Instance 608fc7e4-4ccf-4823-82af-392b80004b29 could not be found. {{(pid=124820) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 26 16:52:19.299220 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO nova.api.openstack.requestlog [None req-3bf683c5-b148-4eb3-b185-7bd5b6cf7005 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29" status: 404 len: 111 microversion: 2.1 time: 0.028586 Jul 26 16:52:19.299220 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: [pid: 124820|app: 0|req: 651/1316] 10.222.0.144 () {58 vars in 1241 bytes} [Tue Jul 26 16:52:19 2022] GET /compute/v2.1/servers/608fc7e4-4ccf-4823-82af-392b80004b29 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 26 16:52:20.870031 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: DEBUG nova.api.openstack.wsgi [None req-4eea7dad-eb27-4491-8fb0-6d950dee25c5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] Calling method '.version_select at 0x7f4b6c15a790>' {{(pid=124821) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 26 16:52:21.003132 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO nova.api.openstack.requestlog [None req-4eea7dad-eb27-4491-8fb0-6d950dee25c5 tempest-TestVolumeBootPattern-165332593 tempest-TestVolumeBootPattern-165332593-project] 10.222.0.144 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-828638125" status: 202 len: 0 microversion: 2.1 time: 0.136962 Jul 26 16:52:21.003718 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: [pid: 124821|app: 0|req: 666/1317] 10.222.0.144 () {58 vars in 1265 bytes} [Tue Jul 26 16:52:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-828638125 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 26 16:52:48.679490 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:52:48.680137 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Tue Jul 26 16:52:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:52:49.635933 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:52:49.636469 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:52:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:54:27.924115 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:54:27.924857 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:54:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:55:01.834504 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:55:01.835207 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:55:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:55:02.046316 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:55:02.046917 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Tue Jul 26 16:55:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:56:08.687788 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:56:08.688415 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Tue Jul 26 16:56:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:56:09.644442 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:56:09.645020 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:56:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:57:41.607669 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:57:41.608161 dv-cinder-851042-1-iscsi devstack@n-api.service[124821]: Tue Jul 26 16:57:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 26 16:57:47.933199 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 26 16:57:47.933799 dv-cinder-851042-1-iscsi devstack@n-api.service[124820]: Tue Jul 26 16:57:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!